Learning, Improving, and Generalizing Motor Skills for the Peg-in-Hole Tasks Based on Imitation Learning and Self-Learning
- Title
- Learning, Improving, and Generalizing Motor Skills for the Peg-in-Hole Tasks Based on Imitation Learning and Self-Learning
- Author
- 서일홍
- Keywords
- peg-in-hole task; reinforcement learning; hidden Markov model; dynamic movement primitive; robot; motor skill
- Issue Date
- 2020-02
- Publisher
- MDPI
- Citation
- APPLIED SCIENCES-BASEL, v. 10, no. 8, article no. 2719
- Abstract
- We propose a framework based on imitation learning and self-learning to enable robots to learn, improve, and generalize motor skills. The peg-in-hole task is important in manufacturing assembly work. Two motor skills for the peg-in-hole task are targeted: "hole search" and "peg insertion". The robots learn initial motor skills from human demonstrations and then improve and/or generalize them through reinforcement learning (RL). An initial motor skill is represented as a concatenation of the parameters of a hidden Markov model (HMM) and a dynamic movement primitive (DMP) to classify input signals and generate motion trajectories. Reactions are classified as familiar or unfamiliar (i.e., modeled or not modeled), and initial motor skills are improved to solve familiar reactions and generalized to solve unfamiliar reactions. The proposed framework includes processes, algorithms, and reward functions that can be used for various motor skill types. To evaluate our framework, the motor skills were performed using an actual robotic arm and two reward functions for RL. To verify the learning and improving/generalizing processes, we successfully applied our framework to different shapes of pegs and holes. Moreover, the execution time steps and path optimization of RL were evaluated experimentally.
- URI
- https://www.mdpi.com/2076-3417/10/8/2719https://repository.hanyang.ac.kr/handle/20.500.11754/161314
- ISSN
- 2076-3417
- DOI
- 10.3390/APP10082719
- Appears in Collections:
- COLLEGE OF ENGINEERING[S](공과대학) > ELECTRONIC ENGINEERING(융합전자공학부) > Articles
- Files in This Item:
- Learning, Improving, and Generalizing Motor Skills for the Peg-in-Hole Tasks Based on Imitation Learning and Self-Learning.pdfDownload
- Export
- RIS (EndNote)
- XLS (Excel)
- XML