강화학습의 신속한 학습을 위한 변이형 오토인코더 기반의 조립 특징 추출 네트워크
Variational Autoencoder-based Assembly Feature Extraction Network for Rapid Learning of Reinforcement Learning
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
Since robotic assembly in an unstructured environment is very difficult with existing control methods, studies using artificial intelligence such as reinforcement learning have been conducted. However, since long-time operation of a robot for learning in the real environment adversely affects the robot, so a method to shorten the learning time is needed. To this end, a method based on a pre-trained neural network was proposed in this study. This method showed a learning speed about 3 times than the existing methods, and the stability of reward during learning was also increased. Furthermore, it can generate a more optimal policy than not using a pre-trained neural network. Using the proposed reinforcement learning-based assembly trajectory generator, 100 attempts were made to assemble the power connector within a random error of 4.53 mm in width and 3.13 mm in length, resulting in 100 successes.
Abstract
Since robotic assembly in an unstructured environment is very difficult with existing control methods, studies using artificial intelligence such as reinforcement learning have been conducted. However, since long-time operation of a robot for learning in the real environment adversely affects the robot, so a method to shorten the learning time is needed. To this end, a method based on a pre-trained neural network was proposed in this study. This method showed a learning speed about 3 times than the existing methods, and the stability of reward during learning was also increased. Furthermore, it can generate a more optimal policy than not using a pre-trained neural network. Using the proposed reinforcement learning-based assembly trajectory generator, 100 attempts were made to assemble the power connector within a random error of 4.53 mm in width and 3.13 mm in length, resulting in 100 successes.
참고문헌 (11)
- S.R. Chhatpar, "Search strategies for peg-in-hole assemblies with position uncertainty", IEEE International Workshop on Intelligent Robots and Systems (IROS), pp.1465~1470 (2001), IEEE
- Liang Xie, "Learning to Fill the Seam by Vision: Sub-millimeter Peg-in-hole on Unseen Shapes in Real World", 2022 International Conference on Robotics and Automation (ICRA), pp.2982~2988 (2022), IEEE
- Jingang Jiang, "The state of the art of search strategies in robotic assembly", Journal of Industrial Information Integration, 26, pp.100259~ (2022), Elsevier BV[DOI]
- Gerrit Schoettler, "Deep Reinforcement Learning for Industrial Insertion Tasks with Visual Inputs and Natural Rewards", 2020 IEEE, 2020, 5548~5555[DOI]
- Xin Zhao, "Model accelerated reinforcement learning for high precision robotic assembly", International Journal of Intelligent Robotics and Applications, 4(2), pp.202~216 (2020), Springer Science and Business Media LLC[DOI]
- Yong-Geon Kim, "Reinforcement Learning-based Sim-to-Real Impedance Parameter Tuning for Robotic Assembly", 2021 21st International Conference on Control, Automation and Systems (ICCAS), pp.833~836 (2021), IEEE
- Jianlan Luo*, "Robust Multi-Modal Policies for Industrial Assembly via Reinforcement Learning and Demonstrations: A Large-Scale Study", Robotics: Science and Systems XVII (2021), Robotics: Science and Systems Foundation[DOI]
- Neville Hogan, "Impedance Control: An Approach to Manipulation: Part II—Implementation", Journal of Dynamic Systems, Measurement, and Control, 107(1), pp.8~16 (1985), ASME International[DOI]
- T. Haarnoja, "Soft Actor-Critic : Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor", International Conference on Machine Learning (ICML) (2018)
- D. P. Kingma, "Auto-Encoding Variational Bayes", International Conference on Learning Representations (ICLR) (2014)
- K. Cho, "Learning phrase representations using RNN encoder-decoder for statistical machine translation", Conference on Empirical Methods in Natural Language Processing (EMNLP) (2014)