Deep learning has quickly become a necessity for selfdriving vehicles on Earth. In contrast, the self-driving vehicles on Mars, including NASA’s latest rover, Perseverance, which is planned to land on Mars in February 2021, are still driven by classical machine vision systems. Deep learning capabilities, such as semantic segmentation and object recognition, would substantially benefit the safety and productivity of ongoing and future missions to the red planet. To this end, we created the first large-scale dataset, AI4Mars, for training and validating terrain classification models for Mars, consisting of ~326K semantic segmentation full image labels on 35K images from Curiosity, Opportunity, and Spirit rovers, collected through crowdsourcing. Each image was labeled by ~10 people to ensure greater quality and agreement of the crowdsourced labels. It also includes ~1.5K validation labels annotated by the rover planners and scientists from NASA’s MSL (Mars Science Laboratory) mission, which operates the Curiosity rover, and MER (Mars Exploration Rovers) mission, which operated the Spirit and Opportunity rovers. We trained a DeepLabv3 model on the AI4Mars training dataset and achieved over 96% overall classification accuracy on the test set. The dataset is made publicly available.1


    Zugriff

    Zugriff über TIB

    Verfügbarkeit in meiner Bibliothek prüfen


    Exportieren, teilen und zitieren



    Titel :

    AI4MARS: A Dataset for Terrain-Aware Autonomy on Mars


    Beteiligte:
    Ono, Hiro (Autor:in) / Hong, Xiangyu (Autor:in) / Chiu, Cindy (Autor:in) / Oij, Stephanie (Autor:in) / Gildner, Matthew (Autor:in) / Leopold, Henry A. (Autor:in) / Atha, Deegan (Autor:in) / Swan, R. Michael (Autor:in)

    Erscheinungsdatum :

    2021-06-19


    Medientyp :

    Preprint


    Format :

    Keine Angabe


    Sprache :

    Englisch



    AI4Mars: A Dataset for Terrain-Aware Autonomous Driving on Mars

    Ono, Masahiro / Chiu, Stephanie Oij?Cindy / Gildner, Matthew et al. | NTRS | 2021


    Resilient Risk-Aware Autonomy

    Ingham, Michel D. | NTRS | 2018


    M.A.T.V - Mars All Terrain Vehicle

    Gulden, Florian / Seyrek, Metin | SAE Technical Papers | 2003


    Mars 2020 Terrain Relative Navigation

    Johnson, Andrew E | NTRS | 2021


    Supporting Increased Autonomy for a Mars Rover

    Estlin, Tara / Castano, Rebecca / Gaines, Dan et al. | NTRS | 2008