Multimodal Fusion of Voice and Gesture Data for UAV Control
Multimodal Fusion of Voice and Gesture Data for UAV Control
- New search for: Xiaojia Xiang
- New search for: Qin Tan
- New search for: Han Zhou
- New search for: Dengqing Tang
- New search for: Jun Lai
- New search for: Xiaojia Xiang
- New search for: Qin Tan
- New search for: Han Zhou
- New search for: Dengqing Tang
- New search for: Jun Lai
To enable unmanned aerial vehicle (UAV) operators to efficiently and intuitively convey their commands to a swarm of UAVs, we propose the use of natural and human-centric input modalities, such as voices and gestures. This paper addresses the fusion of input modalities such as voice and gesture data, which are captured through a microphone and a Leap Motion controller, respectively, to control UAV swarms. The obtained experimental results are presented, and the achieved performance (accuracy) is analyzed. Finally, combined human factor ergonomics test with a questionnaire to verify the method’s validity.
Document information
Multimodal Fusion of Voice and Gesture Data for UAV Control
2022
Article (Journal)
Electronic Resource
Unknown
Metadata by DOAJ is licensed under CC BY-SA 1.0
Similar titles
Multimodal Control of UAV Based on Gesture, Eye Movement and Voice Interaction
| Springer Verlag | 2023
VEHICLE CONTROL APPARATUS AND METHOD USING VOICE OR GESTURE
| European Patent Office | 2015
Multimodal Data Fusion for Big Events
| Transportation Research Record | 2016