An example includes obtaining first sensor data from a first sensor and second sensor data from a second sensor, the first sensor of a first sensor type different than a second sensor type of the second sensor; generating first encoded sensor data based on the first sensor data and second encoded sensor data based on the second sensor data; generating a contextual fused sensor data representation of the first and second sensor data based on the first and second encoded sensor data; generating first and second reconstructed sensor data based on the contextual fused sensor data representation; determining a deviation estimation based on the first and second reconstructed sensor data, the deviation estimation representative of a deviation between: (a) the first reconstructed sensor data, and (b) the first sensor data; and detecting an anomaly in the deviation estimation, the anomaly indicative of an error associated with the first sensor.
METHODS AND APPARATUS FOR UNSUPERVISED MULTIMODAL ANOMALY DETECTION FOR AUTONOMOUS VEHICLES
2019-05-09
Patent
Electronic Resource
English
IPC: | B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G05D SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES , Systeme zum Steuern oder Regeln nichtelektrischer veränderlicher Größen / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen |
Methods and apparatus for unsupervised multimodal anomaly detection for autonomous vehicles
European Patent Office | 2022
|