This paper summarizes results of a user evaluation survey of computer-based telephone messaging ("voice mail") technologies. A mail survey of the population of voice mail users in state government agencies approximately 3000 users) yielded 1072 user responses. Survey analyses tested hypotheses regarding how voice mail evaluations are influenced by user characteristics, system use and experience, task and situation factors, and differences in organizational context and operations. Highlights of the results include findings relating both endogenous (age and gender) and exogenous (reported length of experience and average weekly use) user characteristics to ratings of the voice mail interface. Participating organizations reported mean differences in ratings of the interface and situation-based voice mail appropriateness. The findings emphasize the importance of a systems approach to integrate user-centered design and functional, situational, and organizational contexts in order to enhance the success of implementing voice mail and other telecommunications technologies.
What is the meaning of a successful application of a new technology? The mere existence of the technology does not ensure its usefulness or appropriateness for improving the quality, efficiency, or range of tasks that a user may wish to accomplish. For instance, consider a state agency trying to increase the computerization and exchange of agency records by purchasing and distributing a large number of computers. From a purely administrative standpoint, the technology diffusion is complete when the boxes containing the computers arrive and are unpacked. However, if the computers are not used as planned and users instead use the computers only to perform word processing, is this a successful technology implementation? This issue of organizational integration and diffusion of new technologies lies at the heart of the study of implementations of new communications technology presented in this paper.
Some information technology applications and implementations may be particularly suitable for wide diffusion and acceptance in a variety of organizations, based on their easy integration with existing tasks and potential for fulfilling the unmet needs of an organization. One example is electronic voice messaging, or "voice mail." Although voice messaging has been available for decades in the form of answering machines, it now provides enhanced capabilities for sending multiple messages to a number of users simultaneously; for simplified recording, retrieval, and message storage; and for increased variety of sending and receiving options. Unlike prior answering machine systems, current generations of voice mail systems may provide numerous menu options available through the telephone interface.
The continued use of the telephone interface, already established in most organizations, may be one reason that modern voice mail systems are so easily integrated into organizations. Previous research has demonstrated that the acceptability and success of any information technology system (or, indeed, any innovation) is dependent in part on situational, organizational, and technological variables (Adrianson and Hjelmquist, 1991; Allen and Hauptman, 1987; Lea, 1991; Miller, Davis, and Elio, 1990; Rice, Grant, Schmitz, and Torobin, 1990; Rice and Shook, 1988; Rogers, 1983). Therefore, these variables should be included in the discussion of the ability of voice mail in general, or of a particular voice mail product, to meet the needs and task demands of an organization.
Usability, Organizational Context, and
A number of researchers have remarked on the low success rate of organizational implementations of new information technology systems. Some estimates suggest that only 2001o of new systems show real improvements in productivity and organizational functioning (Eason, 1988). …