To enable unmanned aerial vehicle (UAV) operators to efficiently and intuitively convey their commands to a swarm of UAVs, we propose the use of natural and human-centric input modalities, such as voices and gestures. This paper addresses the fusion of input modalities such as voice and gesture data, which are captured through a microphone and a Leap Motion controller, respectively, to control UAV swarms. The obtained experimental results are presented, and the achieved performance (accuracy) is analyzed. Finally, combined human factor ergonomics test with a questionnaire to verify the method’s validity.
Multimodal Fusion of Voice and Gesture Data for UAV Control
2022
Article (Journal)
Electronic Resource
Unknown
Metadata by DOAJ is licensed under CC BY-SA 1.0
Multimodal Control of UAV Based on Gesture, Eye Movement and Voice Interaction
Springer Verlag | 2023
|VEHICLE CONTROL APPARATUS AND METHOD USING VOICE OR GESTURE
European Patent Office | 2015
|Multimodal Data Fusion for Big Events
Transportation Research Record | 2016
|