The increasing level of autonomy and intelligence of robotic systems in carrying out complex tasks can be expected to revolutionize both the industry and our everyday lives. This thesis takes a step towards automation by leveraging the power of path integral control (PIC) methods for solving control problems under such task satisfaction constraints in both a stochastic control and a reinforcement learning setting. PIC-based solutions to these problems offer many benefits, such as their ease of implementation and their natural ability to handle the history-dependent costs stemming from the definition of the complex tasks. They rely on sampling open-loop trajectories of the system to compute control actions and thereby have excellent parallelization capabilities. Their potential for handling complex dynamics effectively during real-time control has also been demonstrated in practice. Nevertheless, their applicability to spatiotemporal logic control has not been thoroughly explored in the literature, which motivates the subject of this thesis. In particular, we focus on robot planning under spatiotemporal logic tasks given in the expressive language of signal temporal logic (STL). We begin by extending path integral control to handle history-dependent costs in a stochastic control setting, providing novel viewpoints, insights, and simplified derivations along the way compared to the existing literature. This includes using path integral control outside of its traditional optimal control setting and instead aiming to achieve performance guarantees with respect to trajectory costs without explicitly considering the applied input effort. This broadens the applicability of PIC, which is also demonstrated through its extension to a multi-agent setting for agents that have independent dynamics, but are coupled through their individual costs. The possibility of augmenting path integral control methods with existing STL control approaches to blend the benefits of these sampling-based and analytical approaches are also ...
Path integral control endowed robot planning under spatiotemporal logic specifications
2022-01-01
Theses
Electronic Resource
English
DDC: | 629 |
Planning and Control of Multi-Agent Systems under Signal Temporal Logic Specifications
BASE | 2020
|Planning and Control of Cooperative Multi-Agent Manipulator-Endowed Systems
BASE | 2018
|Cooperative Manipulation and Motion Planning Under Signal Temporal Logic Specifications
BASE | 2023
|