It is now possible to track people's motion, identify them by facial appearance, and recognize their actions in real time using only modest computational resources. By using this perceptual information we have been able to build smart rooms and smart clothes that have the potential to recognize people, understand their speech, allow them to control computer displays without wires or keyboards, communicate by sign language, and warn them they are about to make a mistake. We imagine eventually building a world where the distinction between inanimate and animate objects begins to blur, and the objects that surround us become more like helpful assistants or playful pets than insensible tools.
Papers are available at our web site, http://www.media.mit.edu/vismod
Becker, D., and Pentland, A., ( 1996) "Using A Virtual Environment to Teach Cancer Patients T'ai Chi, Relaxation and Self-Imagery", M.I.T.Media Laboratory Perceptual Computing Technical Report No. 390.
Mann, S. "Smart Clothing: The Wearable Computer and WearCam", Personal Technologies 1( 1), 1997
Oliver, N., Rosario, B., Pentland, A., ( 1998) Statistical Modeling of Human Interactions, NIPS 98, Denver CO, Dec 4-6
Pentland, A. ( 1996) Smart Rooms, Smart Clothes Scientific American, Vol. 274, No. 4, pp. 68-76, April 1996.
Pentland, A., "Wearable Intelligence" Scientific American Presents, Vol 9, No. 4, Dec. 1998
Pentland, A., and Liu, A., ( 1999) Modeling and Prediction of Human Behavior, Neural Computation, 11, 229-242, Jan 1999
Roy, D., and Pentland, A., ( 1998) "An Adaptive Interface: Learning worlds and their audio-visual grounding" ICSLP98, Sydney, Austrialia, Dec. 1998
Starner, T., Weaver, J., and Pentland, A., ( 1998) Real-Time American Sign Language Recognition from Video Using Hidden Markov Models, IEEE Transactions on Pattern Analysis and Machine Vision, Dec. 1998.
Starner, T., Mann, S., Rhodes, B., Levine, J., Healey, J., Kirsch, D., Picard, R., and Pentland, A., ( 1996) "Visual Augmented Reality Through Wearable Computing", Presence, ( M.I.T. Press), Vol 5, No 2, pp. 163-172.
Wren, C., and Pentland, A., ( 1998) "Dynamic Modeling of Human Motion", IEEE Face and Gesture Conf., Nara, Japan., also M.I.T. Media Laboratory Perceptual Computing Technical Report No. 415