Design of Audio-Visual Interface for Aiding Driver’s Voice Commands in Automotive Environment
Design of Audio-Visual Interface for Aiding Driver’s Voice Commands in Automotive Environment
- New search for: Kim, Kihyeon
- New search for: Jeon, Changwon
- New search for: Park, Junho
- New search for: Jeong, Seokyeong
- New search for: Han, David K.
- New search for: Ko, Hanseok
- New search for: Kim, Kihyeon
- New search for: Jeon, Changwon
- New search for: Park, Junho
- New search for: Jeong, Seokyeong
- New search for: Han, David K.
- New search for: Ko, Hanseok
Abstract This chapter describes an information-modeling and integration of an embedded audio-visual speech recognition system, aimed at improving speech recognition under adverse automobile noisy environment. In particular, we employ lip-reading as an added feature for enhanced speech recognition. Lip motion feature is extracted by active shape models and the corresponding hidden Markov models are constructed for lip-readinglip-reading . For realizing efficient hidden Markov models, tied-mixture technique is introduced for both visual and acoustical information. It makes the model structure simple and small while maintaining suitable recognition performance. In decoding process, the audio-visual information is integrated into the state output probabilities of hidden Markov model as multistream featuresmultistream features . Each stream is weighted according to the signal-to-noise ratio so that the visual information becomes more dominant under adverse noisy environment of an automobile. Representative experimental results demonstrate that the audio-visual speech recognition system achieves promising performance in adverse noisy condition, making it suitable for embedded devices.
Document information
Design of Audio-Visual Interface for Aiding Driver’s Voice Commands in Automotive Environment
2008-10-06
9 pages
Article/Chapter (Book)
Electronic Resource
English
Active shape model , Audio-visual speech interface , Automatic speech recognition , Hybrid integration , Lip-reading , Mel-frequency cepstrum coefficients , Mouth model , Multistream features , SNR-dependent audio–visual information combination , Tied-mixture hidden Markov model Engineering , Automotive Engineering , Signal, Image and Speech Processing , User Interfaces and Human Computer Interaction , Communications Engineering, Networks
Similar titles
Design of Audio-Visual Interface for Aiding Driver's Voice Commands in Automotive Environment
| British Library Conference Proceedings | 2009
Apparatus and method for processing commands by recognizing driver's voice and lips
| European Patent Office | 2023
Quantifying the Night Driver's Visual Environment
| NTIS | 1980
DRIVER'S VISUAL RANGE DETECTION
| SAE Technical Papers | 1972
Three Dimensional Heads-up Display Unit Including Visual Context for Voice Commands
| European Patent Office | 2017