Earticle

초록

영어

This paper focuses on the path planning for a mobile robot which is operated in indoor environment. Since the layout of indoor environment is a hybrid structure of known and unknown, this paper presents a hybrid algorithm which uses the Max-Q method and the option method together. Firstly, a novel task graph and high level definition are presented to divide sub-tasks. Then, the appropriate definitions of states, actions and options could let a robot fulfill a task. Finally, an angle parameter is employed in the reward function to ensure a robot select a shorter path and adjust orientation timely. In the series of simulations, a robot can arrival any position successfully with random initial positions and directions. Moreover the results show that a robot can overcome the local minimal problem with our hybrid method.

목차

Abstract
 1. Introduction
 2. Related Knowledge
  2.1. Reinforcement Learning
  2.2. Hierarchical Reinforcement Learning
 3. The Design of the Hybrid Method
  3.1. States and Actions Definition
  3.2. Options Definition
  3.3. Reward Function
 4. Simulation
  4.1. Partial Simulation
  4.2. Whole Simulation
 5. Conclusion and Future Work
 References

키워드

저자

• Shen Cheng’en [ College of Computer Science & College of Software Engineering, Sichuan University, China ]
• He Jun [ College of Computer Science & College of Software Engineering, Sichuan University, China ]

참고문헌

발행기관

간행물

표지보기 관심저널 등록

• 간행물명

  International Journal of Control and Automation

• 간기

  월간

• pISSN

  2005-4297

• 수록기간

  2008~2016

• 십진분류

  KDC 505 DDC 605