Safe Reinforcement Learning-Based Motion Planning for Functional Mobile Robots Suffering Uncontrollable Mobile Robots

You are here: Homepage > Search

Safe Reinforcement Learning-Based Motion Planning for Functional Mobile Robots Suffering Uncontrollable Mobile Robots

Cao, Huanhui / Xiong, Hao / Zeng, Weifeng / Jiang, Hantao / Cai, Zhiyuan / Hu, Liang / Zhang, Lin / Lu, Wenjie

An increasing number of Autonomous Mobile Robots (AMRs) are used in warehouses and factories in recent years. The risk of some of the AMRs being out of control is surging. Although Reinforcement Learning (RL)-based approaches have achieved dramatic success in the motion planning of a large number of AMRs, the available RL-based motion planning approaches cannot provide a safety guarantee for the remaining functional AMRs if some of the AMRs are out of control. To this end, this paper develops a scalable Multi-agent RL (MARL) with Control Barrier Function (CBF)-based shields algorithm. The MARL with CBF-based shields algorithm can address complex high-level tasks by MARL and deal with the safety issue of every single functional AMR by a low-level CBF-based shield. A CBF-based shield is designed for every single functional AMR to ensure that the action of the functional AMR is safe, even if an uncontrollable AMR is pursuing the functional AMR. Experiments are conducted based on simulated warehouse environments to evaluate the effectiveness and scalability of a safe RL-based motion planning approach (The safe RL-based motion planning approach developed in this study is demonstrated in a video: https://youtu.be/I7ja5nFVpY4). developed according to the MARL with CBF-based shields algorithm.

Access

Check access

Check availability in my library

Order at Subito €

Export, share and cite

Document information

Title :

Safe Reinforcement Learning-Based Motion Planning for Functional Mobile Robots Suffering Uncontrollable Mobile Robots

Contributors:

Cao, Huanhui (author) / Xiong, Hao (author) / Zeng, Weifeng (author) / Jiang, Hantao (author) / Cai, Zhiyuan (author) / Hu, Liang (author) / Zhang, Lin (author) / Lu, Wenjie (author)

Published in:

IEEE Transactions on Intelligent Transportation Systems ; 25 , 5 ; 4346-4363

Publication date :

2024-05-01

Size :

3811759 byte

ISSN :

1524-9050 , 1558-0016

DOI :

https://doi.org/10.1109/TITS.2023.3330183

Type of media :

Article (Journal)