Pick-and-place application using a dual arm collaborative robot and an RGB-D camera with YOLOv5
5
TL;DR: In this paper , a dual arm six-degree-of-freedom (6-DoF) collaborative robot, ABB YuMi, and a red, green, blue-depth (RGB-D) camera with YOLOv5 were used in a pick-and-place application.
read more
Abstract: Nowadays, many industries use robots and cameras in tandem to detect specific objects and perform specific tasks. However, misdetection can occur due to inconsistencies in lighting, background, and environment. In order to address the aforementioned issues, this study proposes using a dual arm six-degree-of-freedom (6-DoF) collaborative robot, ABB YuMi, and red, green, blue-depth (RGB-D) camera with YOLOv5 in a pick-and-place application. In order to prepare the dataset, the images are collected and labeled. The dataset has been trained with the YOLOv5 machine learning algorithm. It has taken on the role of weight for real-time detection. When RGB images from a camera are sent to YOLOv5, data pertaining to the bottle’s position x-y and color are extracted from the depth and color images. The position of the robot is used to control its movement. There are three parts to the experiment. To begin, YOLOv5 is tested with and without trained images. Second, YOLOv5 is tested with real-time camera images. Finally, we assume that YOLOv5 has perfect detection and grasping ability. The results were 95, 90, and 90%.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
An overview of emerging trends in robotics and automation
TL;DR: Robotics and automation are rapidly evolving, integrating AI and ML into various fields. Emerging trends like soft robotics and swarm robotics hold the potential to transform industries and improve efficiency. The future of robotics promises safer workplaces, improved healthcare, and enhanced environmental sustainability.
2
Computer Vision Enabled Pick and Place Robot for Warehouse Automation
Vandana Kumari Prajapati,S Shashank,M. Nithya +2 more
- 18 Sep 2024
TL;DR: This research develops a computer vision-enabled pick-and-place robot for warehouse automation, merging advanced computer vision with robotic arms to accurately identify, grab, and transfer goods of varied sizes, shapes, and positions using machine learning and a Raspberry Pi.
1
Vision-Guided Pick and Place Systems Using Raspberry Pi and YOLO
G. Hemanth Kumar,D. R. Kumar Raja,Sunil Suresh,Rishi Kottamala,Macha Harsith +4 more
- 22 Aug 2024
Real-Time Interactive Capabilities of Dual-Arm Systems for Humanoid Robots in Unstructured Environments
Wei Jia,Alejandro Ramirez‐Serrano,Бо Лю +2 more
- 28 Aug 2024
TL;DR: This paper presents a novel strategy for real-time interactive motion operations in humanoid robots, integrating a camera-based target detection system and a kinematic technique to optimize dual-arm coordination, achieving 50x faster position transfer and improved grasping response in unstructured environments.
Robot arm grasping based on YOLOv5 in the perspective of automated production
Liang Wang
TL;DR: This study proposes a new robotic arm grasping control model based on YOLOv5, improving grasping efficiency and reducing control costs in complex production environments, achieving a 94% success rate and 35.67 joules average energy consumption.
References
Fast R-CNN
Ross Girshick
- 07 Dec 2015
TL;DR: Fast R-CNN as discussed by the authors proposes a Fast Region-based Convolutional Network method for object detection, which employs several innovations to improve training and testing speed while also increasing detection accuracy and achieves a higher mAP on PASCAL VOC 2012.
Real-Time Seamless Single Shot 6D Object Pose Prediction
Bugra Tekin,Sudipta N. Sinha,Pascal Fua +2 more
- 18 Jun 2018
TL;DR: A single-shot approach for simultaneously detecting an object in an RGB image and predicting its 6D pose without requiring multiple stages or having to examine multiple hypotheses is proposed, which substantially outperforms other recent CNN-based approaches when they are all used without postprocessing.
Apple detection during different growth stages in orchards using the improved YOLO-V3 model
TL;DR: The test results show that the proposed YOLOV3-dense model is superior to the original YOLO-V3 model and the Faster R-CNN with VGG16 net model, which is the state-of-art fruit detection model.
905
Understanding of Object Detection Based on CNN Family and YOLO
Juan Du
- 01 Apr 2018
TL;DR: One of the best CNN representatives You Only Look Once (YOLO), which breaks through the CNN family's tradition and innovates a complete new way of solving the object detection with most simple and high efficient way.
397
Tinier-YOLO: A Real-Time Object Detection Method for Constrained Environments
Wei Fang,Wang Lin,Ren Peiming +2 more
TL;DR: Tinier-YOLO is proposed to further shrink the model size while achieving improved detection accuracy and real-time performance and it posses comparable results in mAP and faster runtime speed with smaller model size and BFLOP/s value compared with other lightweight models like SqueezeNet SSD and MobileNet SSD.