Multimodal Human-Computer Communication in
Technical ApplicationsHernitann Hienz, Jörg Marrenbach, Roland Steffan, and Suat Akyol Department of Technical Computer Science Aachen University of Technology
Ahornstr. 55, D-52074 Aachen, Germany
Phone: +49-241-8026105 Fax: +49-241-8888308
Email: [hienz, marrenbach, steffan, akyol] @ techinfo.rwth-aachen.de
IntroductionHuman-computer interfaces represent the borderline between the computer and
the user. People naturally communicate with other people and their environment
by means of different modalities, e.g., speech, gestures, touch, and mimic.
Therefore, the development of advanced human-computer interfaces, which are
more natural, efficient and intuitive is worthwhile ( Bolt 1984). In our department a research group is concerned with the development and evaluation of
multimodal human-computer interfaces in technical applications. Where nowadays the most popular input modalities relies on keyboard and mouse, future
interfaces will benefit from natural communication modes.According to develop advanced multimodal human-computer interfaces, research is focussed on the following topics:
|• ||analysis of natural communication procedure|
|• ||selection of communication modality and its context-dependent use|
|• ||suitable combination of input as well as output modalities|
Multimodal human-computer communication might be appropriate for operating
a wide range of applications, e.g., multimodal information browsing. Regarding
technical applications, such as machine tools, it will be advantageous if the user
can operate the machine in a hands-free and eyes-free manner instead of using a
keyboard-and monitor-based input system. A multimodal input device can be a
useful add-on or even a substitute for common input devices. It creates new
functionality and comfort for controlling technical systems.
The system architecture for multimodal human-machine communication is depicted in figure 1.
Questia, a part of Gale, Cengage Learning. www.questia.com
Book title: Human-Computer Interaction:Ergonomics and User Interfaces.
Contributors: Hans-Jörg Bullinger - Editor, Jürgen Ziegler - Editor.
Publisher: Lawrence Erlbaum Associates.
Place of publication: Mahwah, NJ.
Publication year: 1999.
Page number: 755.
This material is protected by copyright and, with the exception of fair use, may
not be further copied, distributed or transmitted in any form or by any means.