Autonomous vehicles are currently a subject of great interest and there is heavy research on creating and improving algorithms for detecting objects in their vicinity. A ROS-based deep learning approach has been developed to detect objects using point cloud data. With encoded raw light detection and ranging (LiDAR) and camera data, several basic statistics such as elevation and density are generated. The system leverages a simple and fast convolutional neural network (CNN) solution for object identification and localization classification and generation of a bounding box to detect vehicles, pedestrians and cyclists was developed. The system is implemented on an Nvidia Jetson TX2 embedded computing platform, the classification and location of the objects are determined by the neural network. Coordinates and other properties of the object are published on to various ROS topics which are then serviced by visualization and data handling routines. Performance of the system is scrutinized with regards to hardware capability, software reliability, and real-time performance. The final product is a mobile-platform capable of identifying pedestrians, cars, trucks and cyclists.
LiDAR and Camera-Based Convolutional Neural Network Detection for Autonomous Driving
Sae Technical Papers
WCX SAE World Congress Experience ; 2020
2020-04-14
Conference paper
English
Vehicle Autonomous Driving Method Using Camera and LiDAR Sensor
European Patent Office | 2019
|Sim2Real Autonomous Driving Using Convolutional Neural Network for Urban Environments
Springer Verlag | 2024
|