현실 세계에서의 로봇 파지 작업을 위한 정책/가치 심층 강화학습 플랫폼 개발
Development of an Actor-Critic Deep Reinforcement Learning Platform for Robotic Grasping in Real World
1
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
In this paper, we present a learning platform for robotic grasping in real world, in which actor-critic deep reinforcement learning is employed to directly learn the grasping skill from raw image pixels and rarely observed rewards. This is a challenging task because existing algorithms based on deep reinforcement learning require an extensive number of training data or massive computational cost so that they cannot be affordable in real world settings. To address this problems, the proposed learning platform basically consists of two training phases; a learning phase in simulator and subsequent learning in real world. Here, main processing blocks in the platform are extraction of latent vector based on state representation learning and disentanglement of a raw image, generation of adapted synthetic image using generative adversarial networks, and object detection and arm segmentation for the disentanglement. We demonstrate the effectiveness of this approach in a real environment.
Abstract
In this paper, we present a learning platform for robotic grasping in real world, in which actor-critic deep reinforcement learning is employed to directly learn the grasping skill from raw image pixels and rarely observed rewards. This is a challenging task because existing algorithms based on deep reinforcement learning require an extensive number of training data or massive computational cost so that they cannot be affordable in real world settings. To address this problems, the proposed learning platform basically consists of two training phases; a learning phase in simulator and subsequent learning in real world. Here, main processing blocks in the platform are extraction of latent vector based on state representation learning and disentanglement of a raw image, generation of adapted synthetic image using generative adversarial networks, and object detection and arm segmentation for the disentanglement. We demonstrate the effectiveness of this approach in a real environment.
참고문헌 (17)
- D. Quillen, "Deep reinforcement learning for vision-based robotic grasping : A simulated comparative evaluation of off-policy methods", 2018IEEE International Conference on Robotics and Automation (ICRA) (2018)
- "Qt-opt: Scalable deep reinforcement learning for visionbased robotic manipulation, arXiv:1806.10293" (2018)[URL]
- "Acceleration of Actor-Critic Deep Reinforcement Learning for Visual Grasping in Clutter by State Representation Learning Based on Disentanglement of a Raw Input Image, arXiv:2002.11903" (2020)[URL]
- J. Mahler, "Dex-Net 3.0: Computing robust vacuum suction grasp targets in point clouds using a new analytic model and deep learning", 2018 IEEE International Conference on Robotics and Automation (ICRA) (2018)
- S. Levine, "Learning hand-eye coordination for robotic grasping with large-scale data collection", International Symposium on Experimental Robotics, pp.173~184 (2016)
- C. Finn, "Deep spatial autoencoders for visuomotor learning", 2016 IEEE International Conference on Robotics and Automation (ICRA) (2016)
- H. van Hoof, "Stable reinforcement learning with autoencoders for tactile and visual data", 2016 IEEE, 2016, ~
- I. Higgins, "beta-VAE: Learning basic visual concepts with a constrained variational framework", ICLR (2017)
- K. Bousmalis, "Using simulation and domain adaptation to improve efficiency of deep robotic grasping", 2018 IEEE International Conference on Robotics and Automation (ICRA) (2018)
- "Distributed distributional deterministic policy gradients, arXiv:1804.08617" (2018)[URL]
- "Continuous control with deep reinforcement learning, arXiv:1509.02971" (2016)[URL]
- P. Vincent, "Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion", Journal of Machine Learning Research (2010)
- "Yolov3: An incremental improvement, arXiv:1804.02767" (2018)[URL]
- "Auto-encoding variational Bayes, arXiv:1312.6114" (2013)[URL]
- S. Ren, "Faster R-CNN : Toward Real-Time Object Detection with Region Proposal Networks", IEEE Transactions on Pattern Analysis and Machine Intelligence (2015)[DOI]
- A. Lukezic, "Discriminative Correlation Filter Tracker with Channel and Spatial Reliability", International Journal of Computer Vision (2019)[DOI]
- V. Badrinarayanan, "Segnet : a deep convolutional encoder–decoder architecture for image segmentation", IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(12), pp.2481~2495 (2017)[DOI]