Fusion of 3D LIDAR and Camera Data for Object Detection in Autonomous Vehicle Applications
TL;DR: A novel object detection and identification method that fuses the complementary information obtained by two types of sensors, 3D LIDAR and vision cameras, that meets the real-time demand of autonomous vehicles.
read more
Abstract: It is vital that autonomous vehicles acquire accurate and real-time information about objects in their vicinity, which fully guarantees the safety of the passengers and vehicle in various environments. Three-dimensional light detection and ranging (3D LIDAR) sensors can directly obtain the position and geometric structure of an object within its detection range, whereas the use of vision cameras is most suitable for object recognition. Accordingly, in this paper, we present a novel object detection and identification method that fuses the complementary information obtained by two types of sensors. First, we utilise 3D LIDAR data to generate accurate object-region proposals. Then, these candidates are mapped onto the image space from which regions of interest (ROI) of the proposals are selected and input to a convolutional neural network (CNN) for further object recognition. To precisely identify the sizes of all the objects, we combine the features of the last three layers of the CNN to extract multi-scale features from the ROIs. The evaluation results obtained on the KITTI dataset demonstrate that: (1) unlike sliding windows that produce thousands of candidate object-region proposals, 3D LIDAR provides an average of 86 real candidates per frame and the minimal recall rate is better than 95%, which greatly decreases the extraction time; (2) The average processing time for each frame of the proposed method is only 66.79 ms, which meets the real-time demand of autonomous vehicles; (3) The average identification accuracies of our method for cars and pedestrians at a moderate level of difficulty are 89.04% and 78.18%, respectively, which is better than those of most previous methods.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
The Design of Preventive Automated Driving Systems Based on Convolutional Neural Network
TL;DR: In this paper, the authors used Faster R-CNN and You Only Look Once (YOLO) V2 to improve the recognition techniques of vehicle-mounted monocular cameras for the design of preventive automated driving systems, recognizing surrounding vehicles in black box highway driving videos and estimating distances from surrounding vehicles through more suitable models for automated driving system.
10
Cost Effective Mobile Mapping System for Color Point Cloud Reconstruction.
TL;DR: Experimental results show that the color point cloud reconstructed by the proposed MMS has a position error in centimeter-level accuracy, meeting the requirement of high definition (HD) maps for autonomous driving usage.
10
A Data Fusion Model for Millimeter-Wave Radar and Vision Sensor in Advanced Driving Assistance System
TL;DR: In this paper, a data fusion model designed for the pair of radar and vision is proposed with a three-level hierarchical structure, which includes screening of original sensor data, sensor data correlation, and target track forecast.
10
A New Density-Based Clustering Method Considering Spatial Distribution of Lidar Point Cloud for Object Detection of Autonomous Driving
TL;DR: Results show that compared with DSC using a circular neighborhood, DAC has a better clustering performance and can notably reduce the rate of over-segmentation and under-se segmentation.
10
Density Aware 3D Object Single Stage Detector
TL;DR: A method of defining point density of point cloud and the network processing strategies on the basis of the calculated density are proposed in DA-3DSSD, which improves the detection precision and strengthens the classification ability of the network.
10
References
•Proceedings Article
Very Deep Convolutional Networks for Large-Scale Image Recognition
Karen Simonyan,Andrew Zisserman +1 more
- 04 Sep 2014
TL;DR: This work investigates the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting using an architecture with very small convolution filters, which shows that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 weight layers.
102.6K
ImageNet: A large-scale hierarchical image database
Jia Deng,Wei Dong,Richard Socher,Li-Jia Li,Kai Li,Li Fei-Fei +5 more
- 20 Jun 2009
TL;DR: A new database called “ImageNet” is introduced, a large-scale ontology of images built upon the backbone of the WordNet structure, much larger in scale and diversity and much more accurate than the current image datasets.
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
TL;DR: This work introduces a Region Proposal Network (RPN) that shares full-image convolutional features with the detection network, thus enabling nearly cost-free region proposals and further merge RPN and Fast R-CNN into a single network by sharing their convolutionAL features.
•Proceedings Article
Very Deep Convolutional Networks for Large-Scale Image Recognition
Karen Simonyan,Andrew Zisserman +1 more
- 01 Jan 2015
TL;DR: In this paper, the authors investigated the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting and showed that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 layers.
51.9K
You Only Look Once: Unified, Real-Time Object Detection
Joseph Redmon,Santosh K. Divvala,Ross Girshick,Ali Farhadi +3 more
- 27 Jun 2016
TL;DR: Compared to state-of-the-art detection systems, YOLO makes more localization errors but is less likely to predict false positives on background, and outperforms other detection methods, including DPM and R-CNN, when generalizing from natural images to other domains like artwork.