In one embodiment, an emergency vehicle detection system can be provided in the ADV travelling on a road to detect the presence of an emergency vehicle in a surrounding environment of the ADV using both audio data and visual data. The emergency vehicle detection system can use a trained neutral network to independently generate a detection result from the audio data, and use another trained network to independently generate another detection result from the visual data. The emergency vehicle detection system can fuse the two detection results to determine the position and moving direction of the emergency vehicle. The ADV can take appropriate actions in response to the position and moving direction of the emergency vehicle.


    Access

    Download


    Export, share and cite



    Title :

    EMERGENCY VEHICLE DETECTION FUSING AUDIO AND VISUAL DATA


    Additional title:

    AKUSTISCHE UND VISUELLE ERKENNUNG VON NOTFAHRZEUGEN NACH EINER FUSION
    DÉTECTION AUDIO ET VISUELLE DE VÉHICULE D'URGENCE APRÈS FUSION


    Contributors:
    XU KECHENG (author) / SUN HONGYI (author) / LUO QI (author) / WANG WEI (author) / LIN ZEJUN (author) / REYNOLDS WESLEY (author) / LIU FENG (author) / HU JIANGTAO (author) / MIAO JINGHAO (author)

    Publication date :

    2022-07-20


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    G06K Erkennen von Daten , RECOGNITION OF DATA / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06V / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS



    Machine learning model fusing emergency vehicle audio and visual detection

    XU KECHENG / SUN HONGYI / LUO QI et al. | European Patent Office | 2021

    Free access

    MACHINE LEARNING MODEL TO DETECT EMERGENCY VEHICLES FUSING AUDIO AND VISUAL SIGNALS

    XU KECHENG / SUN HONGYI / LUO QI et al. | European Patent Office | 2024

    Free access

    Vehicle detection fusing 2D visual features

    Hoffman, C. / Dang, T. / Stiller, C. | IEEE | 2004


    EMERGENCY VEHICLE AUDIO AND VISUAL DETECTION POST FUSION

    XU KECHENG / SUN HONGYI / LUO QI et al. | European Patent Office | 2022

    Free access

    EMERGENCY VEHICLE AUDIO AND VISUAL DETECTION POST FUSION

    European Patent Office | 2023

    Free access