Brain Potentials after Clicking a Mouse: A New Psychophysiological Approach to Human-Computer Interaction

By Nittono, Hiroshi; Hamada, Aya et al. | Human Factors, Winter 2003 | Go to article overview

Brain Potentials after Clicking a Mouse: A New Psychophysiological Approach to Human-Computer Interaction


Nittono, Hiroshi, Hamada, Aya, Hori, Tadao, Human Factors


INTRODUCTION

In human factors and engineering psychological research, event-related brain potentials (ERPs) have been applied to assess mental workload (Kramer & Weber, 2000). In particular, the P3 (P300) component of the ERP is proposed to reflect the amount of perceptual-central processing resources allocated to the eliciting event (Donchin, Kramer, & Wickens, 1986).

Currently, three ERP techniques are used for assessing mental workload: (a) relevant probe technique (Fowler, 1994; Kramer, Sirevaag, & Braune, 1987); (b) irrelevant probe technique (Kramer, Trejo, & Humphrey, 1995; Ullsperger, Freude, & Erdmann, 2001); and (c) primary task technique (Kramer, Wickens, & Donchin, 1985; Sirevaag, Kramer, Coles, & Donchin, 1989). In the first two probe techniques, mental workload of the primary task is assessed indirectly with probe stimuli to which the participant has to pay attention (relevant probes) of pay no attention (irrelevant probes). It is suggested that a smaller P3 amplitude for the probe stimuli is associated with a higher processing demand of the primary task. However, the probe techniques are valid only under the assumption that the total amount of processing resources allocated to the primary task and the probe stimuli is constant, which is not always guaranteed.

The primary task technique assesses the participant's state of attention directly by measuring the P3 to certain discrete events embedded in the primary task (e.g., infrequent step changes of the target position in a tracking task). The more processing resources that are allocated to the primary task, the larger the P3 amplitude is for primary task events. The primary task technique appears to have an advantage over the probe techniques in that it is not based on the trade-off assumption. However, a paucity of discrete events that can be used as triggers for ERP averaging allows limited opportunities for applying it to real-world tasks.

In the present study, we propose a new candidate for the primary task technique to assess mental workload in human-computer interaction (HCI). When operating a computer, the user executes an intentional action to achieve a certain goal and evaluates whether a response from the computer is fit for the goal (Frese & Zapf, 1994; Norman, 1986). Theoretically, it is possible to record ERPs for a computer's response to the user's action. If a computer is programmed to produce an irregular response infrequently, a P3 will be elicited by that event, and its amplitude will be directly related to the amount of processing resources allocated to the task. We give a nickname, mouse click paradigm, to the procedure for measuring ERPs to the event triggered by the user's intentional action, given that mouse clicking is one of the most commonly executed actions in current HCI. In addition to mouse clicking, this action-perception paradigm is applicable to key pressing and similar actions in HCI tasks.

Although the idea is attractive, several problems should be addressed before using this method for practical applications. First, little is known about the nature of the ERPs to stimuli triggered by voluntary actions. In previous studies, ERPs were typically recorded for stimuli presented by the experimenter. The participant did nothing except keep still and wait for the stimuli. The idea of recording ERPs in an interactive task has a long history (e.g., O'Connor, 1981 ; Papakostopoulos, 1980; Rohrbaugh et al., 1986), yet few empirical studies have compared ERPs to stimuli triggered by voluntary actions with ERPs to the same stimuli presented automatically (McCarthy & Donchin, 1976; Schafer & Marcus, 1973). In the present context, it is necessary to examine whether the P3 is altered by the method of triggering stimuli. In a previous study, this issue was examined using an auditory target detection task (oddball task; Nittono & Ullsperger, 2000). When the stimuli were triggered by voluntary mouse clicks, the amplitude of the P3 was larger than when the same stimuli were presented automatically without mouse clicks. …

The rest of this article is only available to active members of Questia

Already a member? Log in now.

Notes for this article

Add a new note
If you are trying to select text to create highlights or citations, remember that you must now click or tap on the first word, and then click or tap on the last word.
One moment ...
Default project is now your active project.
Project items

Items saved from this article

This article has been saved
Highlights (0)
Some of your highlights are legacy items.

Highlights saved before July 30, 2012 will not be displayed on their respective source pages.

You can easily re-create the highlights by opening the book page or article, selecting the text, and clicking “Highlight.”

Citations (0)
Some of your citations are legacy items.

Any citation created before July 30, 2012 will labeled as a “Cited page.” New citations will be saved as cited passages, pages or articles.

We also added the ability to view new citations from your projects or the book or article where you created them.

Notes (0)
Bookmarks (0)

You have no saved items from this article

Project items include:
  • Saved book/article
  • Highlights
  • Quotes/citations
  • Notes
  • Bookmarks
Notes
Cite this article

Cited article

Style
Citations are available only to our active members.
Buy instant access to cite pages or passages in MLA, APA and Chicago citation styles.

(Einhorn, 1992, p. 25)

(Einhorn 25)

1. Lois J. Einhorn, Abraham Lincoln, the Orator: Penetrating the Lincoln Legend (Westport, CT: Greenwood Press, 1992), 25, http://www.questia.com/read/27419298.

Cited article

Brain Potentials after Clicking a Mouse: A New Psychophysiological Approach to Human-Computer Interaction
Settings

Settings

Typeface
Text size Smaller Larger Reset View mode
Search within

Search within this article

Look up

Look up a word

  • Dictionary
  • Thesaurus
Please submit a word or phrase above.
Print this page

Print this page

Why can't I print more than one page at a time?

Help
Full screen

matching results for page

    Questia reader help

    How to highlight and cite specific passages

    1. Click or tap the first word you want to select.
    2. Click or tap the last word you want to select, and you’ll see everything in between get selected.
    3. You’ll then get a menu of options like creating a highlight or a citation from that passage of text.

    OK, got it!

    Cited passage

    Style
    Citations are available only to our active members.
    Buy instant access to cite pages or passages in MLA, APA and Chicago citation styles.

    "Portraying himself as an honest, ordinary person helped Lincoln identify with his audiences." (Einhorn, 1992, p. 25).

    "Portraying himself as an honest, ordinary person helped Lincoln identify with his audiences." (Einhorn 25)

    "Portraying himself as an honest, ordinary person helped Lincoln identify with his audiences."1

    1. Lois J. Einhorn, Abraham Lincoln, the Orator: Penetrating the Lincoln Legend (Westport, CT: Greenwood Press, 1992), 25, http://www.questia.com/read/27419298.

    Cited passage

    Thanks for trying Questia!

    Please continue trying out our research tools, but please note, full functionality is available only to our active members.

    Your work will be lost once you leave this Web page.

    Buy instant access to save your work.

    Already a member? Log in now.

    Author Advanced search

    Oops!

    An unknown error has occurred. Please click the button below to reload the page. If the problem persists, please try again in a little while.