This paper presents a multimodal crisis management system (XISM). It employs processing of natural gesture and speech commands elicited by a user to efficiently manage complex dynamic emergency scenarios on a large display. The developed prototype system demonstrates the means of incorporating unconstrained free-hand gestures and speech in a real-time interactive interface. This paper provides insights into the design aspects of the XISM system. In particular, it addresses the issues of extraction and fusion of gesture and speech modalities to allow more natural interactive behavior. Performance characteristics of the current prototype and considerations for future work are discussed. A series of studies indicated positive response with respect to ease of interacting with the current system.
Multimodal human-computer interaction for crisis management systems
2002-01-01
302319 byte
Aufsatz (Konferenz)
Elektronische Ressource
Englisch
Multimodal Human-Computer Interaction for Crisis Management Systems
British Library Conference Proceedings | 2002
|Multimodal human-computer interaction: A survey
British Library Online Contents | 2007
|A Conversational Paradigm for Multimodal Human Interaction
British Library Conference Proceedings | 2001
|Multimodal person recognition for human-vehicle interaction
Tema Archiv | 2006
|