This paper proposes an active information-directed reinforcement learning (AID-RL) framework for autonomous source seeking and estimation problem. Source seeking requires the search agent to move towards the true source, and source estimation demands the agent to maintain and update its knowledge regarding the source properties such as release rate and source position. These two objectives give rise to the newly developed framework, namely, dual control for exploration and exploitation. In this paper, the greedy RL forms an exploitation search strategy that navigates the agent to the source position, while the information-directed search commands the agent to explore most informative positions to reduce belief uncertainty. Extensive results are presented using a high-fidelity dataset for autonomous search, which validates the effectiveness of the proposed AID-RL and highlights the importance of active exploration in improving sampling efficiency and search performance.


    Access

    Download


    Export, share and cite



    Title :

    AID-RL: Active information-directed reinforcement learning for autonomous source seeking and estimation


    Contributors:
    Li, Z (author) / Chen, WH (author) / Yang, J (author) / Yan, Y (author)

    Publication date :

    2023-08-01


    Remarks:

    Neurocomputing , 544 , Article 126281. (2023) (In press).


    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Multi-Agent Navigation with Reinforcement Learning Enhanced Information Seeking

    Zhang, Siwei / Guerra, Anna / Guidi, Francesco et al. | German Aerospace Center (DLR) | 2022

    Free access


    Robust source-seeking hybrid controllers for autonomous vehicles

    Mayhew, C.G. / Sanfelice, R.G. / Teel, A.R. | Tema Archive | 2007


    Autonomous Driving with Deep Reinforcement Learning

    Zhu, Yuhua / Technische Universität Dresden | SLUB | 2023


    REINFORCEMENT LEARNING FOR AUTONOMOUS LANE CHANGE

    SHI ZHAN / JIANG YIFEI / LI ANG | European Patent Office | 2024

    Free access