Systems and methods for generating labelled audio data and onboard validation of the labelled audio data utilizing an autonomous driving vehicle (ADV) while the ADV is operating within a driving environment are disclosed. The method includes recording a sound emitted by an object within the driving environment of the ADV, and converting the recorded sound into audio samples. The method further includes labelling the audio samples, and refining the labelled audio samples to produce refined labelled audio data. The refined labelled audio data is utilized to subsequently train a machine learning algorithm to recognize a sound source during autonomous driving of the ADV. The method further includes generating a performance profile of the refined labelled audio data based at least on the audio samples, a position of the object, and a relative direction of the object. The position of the object and the relative direction of the object are determined by a perception system of the ADV.


    Access

    Download


    Export, share and cite



    Title :

    Audio logging for model training and onboard validation utilizing autonomous driving vehicle


    Contributors:
    LUO QI (author) / XU KECHENG (author) / SUN HONGYI (author) / REYNOLDS WESLEY (author) / LIN ZEJUN (author) / WANG WEI (author) / CAO YU (author) / LIN WEIMAN (author)

    Publication date :

    2023-08-22


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    G10L Analyse oder Synthese von Sprache , SPEECH ANALYSIS OR SYNTHESIS / G05D SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES , Systeme zum Steuern oder Regeln nichtelektrischer veränderlicher Größen / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G07C TIME OR ATTENDANCE REGISTERS , Zeit- oder Anwesenheitskontrollgeräte / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS




    AUDIO LOGGING FOR MODEL TRAINING AND ONBOARD VALIDATION UTILIZING AUTONOMOUS DRIVING VEHICLE

    LUO QI / XU KECHENG / SUN HONGYI et al. | European Patent Office | 2022

    Free access

    AUDIO LOGGING FOR MODEL TRAINING AND ONBOARD VALIDATION UTILIZING AUTONOMOUS DRIVING VEHICLE

    LUO QI / XU KECHENG / SUN HONGYI et al. | European Patent Office | 2024

    Free access

    AUDIO LOGGING FOR MODEL TRAINING AND ONBOARD VALIDATION UTILIZING AUTONOMOUS DRIVING VEHICLE

    LUO QI / XU KECHENG / SUN HONGYI et al. | European Patent Office | 2022

    Free access

    AUDIO LOGGING FOR MODEL TRAINING AND ONBOARD VALIDATION UTILIZING AUTONOMOUS DRIVING VEHICLE

    LUO QI / XU KECHENG / SUN HONGYI et al. | European Patent Office | 2022

    Free access