Scene Structure Classification as Preprocessing for Feature-Based Visual Odometry

You are here: Homepage > Search

Scene Structure Classification as Preprocessing for Feature-Based Visual Odometry

Aladem, Mohamed / Rawashdeh, Nathir A. / Rawashdeh, Samir A. / Baek, Stan

Cameras and image processing hardware are rapidly evolving technologies, which enable real-time applications for passenger cars, ground robots, and aerial vehicles. Visual odometry (VO) algorithms estimate vehicle position and orientation changes from the moving camera images. For ground vehicles, such as cars, indoor robots, and planetary rovers, VO can augment movement estimation from rotary wheel encoders. Feature-based VO relies on detecting feature points, such as corners or edges, in image frames as the vehicle moves. These points are tracked over frames and, as a group, estimate motion. Not all detected points are tracked since not all are found in the next frame. Even tracked features may not be correct since a feature point may map to an incorrect nearby feature point. This can depend on the driving scenario, which can include driving at high speed or in the rain or snow. This article investigates the effect of image structural content on the performance of feature tracking and motion estimation from known VO algorithms. As a preprocessing step, the image frame is divided into regions of three classes: Transient, Texture, and Random. The number of tracked features does differ in these regions, as validated by the presented results. VO algorithms can fail intermittently when too few detected points contribute to tracking, where the remaining points are false matches and are outliers to the motion estimator. Exclusion of these poor corners in advance can increase the robustness of the algorithms.