malised user with usual knowledge about the devices and its purpose. These models are built up using the keystroke modelling technique and the GOMS analysis ( Marrenbach and Leuker 1998). The'evaluation of the device can be done by a simulated use via the user model and by tests with prospective users. Action logs are generated automatically and conclusions concerning the operability of the prototype can be drawn, e.g., errors and operating time. Furthermore, the comparison of the normative user models and the action logs of the test user supply predicates about the effectiveness and the efficiency of the device with respect to the different modalities. Additionally, a comparison between the multimodal and conventional system must be carried out in order to evaluate the advantages of the new interface.
In this paper we suggested a multimodal human-computer interface as an alternative to existent systems. The interface is composed of four components: the multimodal input unit, the interpreter, the acquisition of situation elements and its valuation, and finally the output unit. The system is based on natural communication modes, e.g., gestures and speech, and offers different ways of user feedback, especially acoustic, visual, and haptic.
Future development will concentrate on the realization of a technical application which will be evaluated analytically as well as empirically.
Akyol, S. & H. Hienz ( 1999). "Controlling Technical Systems with Gestures". In Kraiss, K.-F. (Eds.): Bi-Annual Report - Department of Technical Computer Science, Shaker-Verlag Aachen.
Bolt, R. A. ( 1984). "The Human Interface - Where People and Computers Meet". Belmont (USA). Lifetime Learning Publications.
Marrenbach, J. & S. Leuker ( 1998). "Konzept zur Evaluierung technischer Systeme in der Entwicklungsphase". In: ITG-Fachbericht: Technik für den Menschen. Gestaltung und Einsatz benutzerfreundlicher Produkte, VDE-Verlag, Berlin, Bd. 154, S. 103-112.
Steffan, R., T. Kuhlen & A. Loock ( 1998). "A Virtual Workplace including a Multimodal Human Computer Interface for Interactive Assembly Planning". In Kopacek, P. (Eds.): Proc. of the IEEE Int. Conference on Intelligent Engineering Systems INES '98, September 17-19, Vienna (Austria), pp. 145-150, IEEE Press.