Learning Hand-Eye Coordination for Robotic Grasping with Deep Learning and Large-Scale Data Collection
TL;DR: The approach achieves effective real-time control, can successfully grasp novel objects, and corrects mistakes by continuous servoing, and illustrates that data from different robots can be combined to learn more reliable and effective grasping.
read more
Abstract: We describe a learning-based approach to hand-eye coordination for robotic grasping from monocular images. To learn hand-eye coordination for grasping, we trained a large convolutional neural netwo...
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Deep Reinforcement Learning: A Brief Survey
TL;DR: Deep reinforcement learning (DRL) is poised to revolutionize the field of artificial intelligence (AI) and represents a step toward building autonomous systems with a higher-level understanding of the visual world as discussed by the authors.
3.1K
A brief survey of deep reinforcement learning
TL;DR: This survey will cover central algorithms in deep RL, including the deep Q-network (DQN), trust region policy optimization (TRPO), and asynchronous advantage actor critic, and highlight the unique advantages of deep neural networks, focusing on visual understanding via RL.
Learning dexterous in-hand manipulation:
OpenAI: Marcin Andrychowicz,Bowen Baker,Maciek Chociej,Rafal Jozefowicz,Bob McGrew,Jakub Pachocki,Arthur Petron,Matthias Plappert,Glenn Powell,Alex Ray,Jonas Schneider,Szymon Sidor,Josh Tobin,Peter Welinder,Lilian Weng,Wojciech Zaremba +15 more
TL;DR: This work uses reinforcement learning (RL) to learn dexterous in-hand manipulation policies that can perform vision-based object reorientation on a physical Shadow Dexterous Hand, and these policies transfer to the physical robot despite being trained entirely in simulation.
•Posted Content
Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problems
TL;DR: This tutorial article aims to provide the reader with the conceptual tools needed to get started on research on offline reinforcement learning algorithms: reinforcementlearning algorithms that utilize previously collected data, without additional online data collection.
1.7K
Sim-to-Real Transfer of Robotic Control with Dynamics Randomization
Xue Bin Peng,Marcin Andrychowicz,Wojciech Zaremba,Pieter Abbeel +3 more
- 21 May 2018
TL;DR: In this article, the authors demonstrate a simple method to bridge the "reality gap" by randomizing the dynamics of the simulator during training and develop policies that are capable of adapting to very different dynamics, including ones that differ significantly from the dynamics on which the policies were trained.
1.6K
References
A Survey of Research on Cloud Robotics and Automation
TL;DR: This survey considers robots and automation systems that rely on data or code from a network to support their operation, i.e., where not all sensing, computation, and memory is integrated into a standalone system.
•Posted Content
Embed to Control: A Locally Linear Latent Dynamics Model for Control from Raw Images
TL;DR: In this article, a deep generative model, belonging to the family of variational autoencoders, is used to generate image trajectories from a latent space in which the dynamics is constrained to be locally linear.
772
Data-Driven Grasp Synthesis - A Survey
TL;DR: A survey of data-driven grasp synthesis can be found in this article, where the authors divide the approaches into three groups based on whether they synthesize grasps for known, familiar or unknown objects.
Relative end-effector control using Cartesian position based visual servoing
W.J. Wilson,C.C. Williams Hulls,G.S. Bell +2 more
- 01 Oct 1996
TL;DR: This paper presents a complete design methodology for Cartesian position based visual servo control for robots with a single camera mounted at the end-effector and the implementation using a distributed computer architecture is described.
683
Learning descriptors for object recognition and 3D pose estimation
Paul Wohlhart,Vincent Lepetit +1 more
- 07 Jun 2015
TL;DR: This work introduces a simple but powerful approach to computing descriptors for object views that efficiently capture both the object identity and 3D pose, and trains a Convolutional Neural Network to compute these descriptors by enforcing simple similarity and dissimilarity constraints between the descriptors.
Related Papers (5)
Kaiming He,Xiangyu Zhang,Shaoqing Ren,Jian Sun +3 more
- 27 Jun 2016