Intuitive human-robot interaction using augmented reality: A simulation study on KUKA IIWA robot

TL;DR: This work combines mixed-reality and digital twin technologies to develop a natural, dynamic, and fast approach to (re-)program robots that decouples motion planning driven by augmented reality, application-agnostic connectivity, and physical motion execution to augment even novice users with the capability to move a robot between freely and intuitively specified Cartesian frames without writing any code.

TL;DR: A codeless, inclusive, and end-to-end robotized manipulation framework is proposed, leveraging extended reality and digital twins, enabling novices to program robot motions without coding, facilitating efficient production and assistance in smart factories and home settings.

TL;DR: A novel concept and platform is developed for multimodal Augmented Reality-based training of maintenance and assembly skills, which includes sub-skill training and the evaluation of the training system, which focuses on procedural skills and the appropriate methods for improving them.

TL;DR: An augmented reality robotic interface with four interactive functions to ease the robot programming task and an industrial case study that illustrates the AR manufacturing paradigm by interacting with a 7-DOF robot arm to reduce wrinkles during the pleating step of the carbon-fiber-reinforcement-polymer vacuum bagging process in a simulated scenario.

TL;DR: A Mixed Reality Head-Mounted Display (MRHMD) interface that enables end-users to easily create and edit robot motions using waypoints is presented, and a higher number of users were able to complete both tasks in significantly less time, and reported experiencing lower cognitive workload, higher usability, and higher naturalness with the MR-HMD interface.

TL;DR: The proposed framework has been tested on pick-and-place and contact operations execution by UR10e and KUKA iiwa robots and provides the possibility of scaling virtual and real worlds for more accurate planning.