Smartkom: adaptive and flexible multimodal access to multiple applications

N Reithinger, J Alexandersson, T Becker… - Proceedings of the 5th …, 2003 - dl.acm.org
N Reithinger, J Alexandersson, T Becker, A Blocher, R Engel, M Löckelt, J Müller, N Pfleger…
Proceedings of the 5th international conference on Multimodal interfaces, 2003dl.acm.org
The development of an intelligent user interface that supports multimodal access to multiple
applications is a challenging task. In this paper we present a generic multimodal interface
system where the user interacts with an anthropomorphic personalized interface agent using
speech and natural gestures. The knowledge-based and uniform approach of SmartKom
enables us to realize a comprehensive system that understands imprecise, ambiguous, or
incomplete multimodal input and generates coordinated, cohesive, and coherent multimodal …
The development of an intelligent user interface that supports multimodal access to multiple applications is a challenging task. In this paper we present a generic multimodal interface system where the user interacts with an anthropomorphic personalized interface agent using speech and natural gestures. The knowledge-based and uniform approach of SmartKom enables us to realize a comprehensive system that understands imprecise, ambiguous, or incomplete multimodal input and generates coordinated, cohesive, and coherent multimodal presentations for three scenarios, currently addressing more than 50 different functionalities of 14 applications. We demonstrate the main ideas in a walk through the main processing steps from modality fusion to modality fission.
ACM Digital Library