This work has developed a hybrid framework that combines machine learning and control approaches for legged robots to achieve new capabilities of balancing against external perturbations. The framework embeds a kernel which is a model-based, full parametric closed-loop and analytical controller as the gait pattern generator. On top of that, a neural network with symmetric partial data augmentation learns to automatically adjust the parameters for the gait kernel, and also generate compensatory actions for all joints, thus significantly augmenting the stability under unexpected perturbations. Seven Neural Network policies with different configurations were optimized to validate the effectiveness and the combined use of the modulation of the kernel parameters and the compensation for the arms and legs using residual actions. The results validated that modulating kernel parameters alongside the residual actions have improved the stability significantly. Furthermore, The performance of the proposed framework was evaluated across a set of challenging simulated scenarios, and demonstrated considerable improvements compared to the baseline in recovering from large external forces (up to 118%). Besides, regarding measurement noise and model inaccuracies, the robustness of the proposed framework has been assessed through simulations, which demonstrated the robustness in the presence of these uncertainties. Furthermore, the trained policies were validated across a set of unseen scenarios and showed the generalization to dynamic walking.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Learning hybrid locomotion skills—Learn to exploit residual actions and modulate model-based gait control


    Beteiligte:
    Kasaei, M (Autor:in) / Abreu, M (Autor:in) / Lau, N (Autor:in) / Pereira, A (Autor:in) / Reis, LP (Autor:in) / Li, Z (Autor:in)

    Erscheinungsdatum :

    2023-04-10


    Anmerkungen:

    Frontiers in Robotics and AI , 10 , Article 1004490. (2023)


    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    Learning locomotion gait through hormone-based controller in modular robots

    Estévez Fernández, David | BASE | 2014

    Freier Zugriff

    Developing locomotion skills with deep reinforcement learning

    Peng, Xue Bin | BASE | 2017

    Freier Zugriff

    Accessibility-Based Clustering for Efficient Learning of Locomotion Skills

    Zhang, C / Yu, W / Li, Z | BASE | 2022

    Freier Zugriff

    Learning Gait Parameters for Locomotion in Virtual Reality Systems

    Zhao, Jingbo / Allison, Robert S. | British Library Conference Proceedings | 2018


    Identifying important sensory feedback for learning locomotion skills

    Yu, Wanming / Yang, Chuanyu / McGreavy, Christopher et al. | BASE | 2023

    Freier Zugriff