To become helpful assistants in our daily lives, robots must be able to understand the effects of their actions on their environment. A modern approach to this is the use of a physics simulation, where often very general simulation engines are utilized. As a result, specific modeling features, such as multi-contact simulation or fluid dynamics, may not be well represented. To improve the representativeness of simulations, we propose a framework for combining estimations of multiple heterogeneous simulations into a single one. The framework couples multiple simulations and reorganizes them based on semantically annotated action sequence information. While each object in the scene is always covered by a simulation, this simulation responsibility can be reassigned on-line. In this paper, we introduce the concept of the framework, describe the architecture, and demonstrate two example implementations. Eventually, we demonstrate how the framework can be used to simulate action executions on the humanoid robot Rollin' Justin with the goal to extract the semantic state and how this information is used to assess whether an action sequence is executed successful or not.


    Access

    Download


    Export, share and cite



    Title :

    Multi-Agent Heterogeneous Digital Twin Framework with Dynamic Responsibility Allocation for Complex Task Simulation


    Contributors:

    Conference:

    2022 ; Online



    Publication date :

    2022-05-01


    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English




    Digital Twin Enabled Multi-task Federated Learning in Heterogeneous Vehicular Networks

    Hui, Yilong / Zhao, Gaosheng / Yin, Zhisheng et al. | IEEE | 2022


    Multi-Agent Task Allocation with Interagent Distance Constraints

    Choi, Euihyeon / Chang, Woohyuk | AIAA | 2023


    Adaptive Task Allocation for Multi-agent Cooperation with Unknown Capabilities

    Li, Jialun / Li, Yushan / Weng, Yulai et al. | IEEE | 2020


    Dynamic Task Allocation for Heterogeneous Multi-UAVs in Uncertain Environments Based on 4DI-GWO Algorithm

    Hanqiao Huang / Zijian Jiang / Tian Yan et al. | DOAJ | 2024

    Free access

    Integrating State-Based Multi-Agent Task Allocation and Physical Simulators

    Rivas, Daniel / Ribas-Xirgo, Lluís | Springer Verlag | 2022