The fusion of 4D millimeter-wave imaging radar and camera is an important development trend of advanced driver assistance systems and autonomous driving. In the field of multi-target tracking, the tracking is easy to lose due to the mutual occlusion of targets in the camera view. Therefore, combining the advantages of visual sensors and 4D millimeter-wave radar, a multi-sensor information fusion association algorithm is proposed. First, the 4D millimeter-wave radar point cloud is preprocessed, outliers are removed, and target-related information in the image is detected; then the point cloud is projected onto the image, and the targets in the segmented region are filtered. The filtered point cloud is clustered, and the correlation between the region projected onto the image and the detection box is calculated. Then use the unscented Kalman filter to predict, design rules to associate targets, and update innovation by multi-point weighting. This paper integrates the information of 4D millimeter-wave radar and camera well when the image target is occluded, thereby obtaining better target recognition and tracking.
Multi-Target Tracking Method Based on Improved Radar and Camera Data Association
Sae Technical Papers
SAE 2023 Intelligent and Connected Vehicles Symposium ; 2023
2023-12-20
Conference paper
English
SAE Technical Papers | 2021
|Multi-target multi-object radar tracking
IEEE | 2003
|3D Multi-Object Tracking Based on Radar-Camera Fusion
IEEE | 2022
|Single Camera Multiplexing for Multi-Target Tracking
British Library Conference Proceedings | 1999
|