Sample Size and the Detection of Means: A Signal Detection Account

By Anderson, Richard B.; Doherty, Michael E. | Memory & Cognition, January 2007 | Go to article overview

Sample Size and the Detection of Means: A Signal Detection Account


Anderson, Richard B., Doherty, Michael E., Memory & Cognition


Using statistical theory as a basis, Kareev (e.g., 1995) claimed that people's ability to correctly infer the existence of a population correlation should be greater for small than for large samples. Simulations by R. B. Anderson, Doherty, Berg, and Friedrich (2005) identified conditions favoring small samples but could not determine whether such an advantage was due to sampling skew, variance, or central tendency displacement. In the present study, we investigated theoretical effects of sample size (n) on the detection of population means under circumstances in which sampling variance is unconfounded with skew or central tendency displacement. The results demonstrate an extremely limited, criterion-specific, small-sample advantage that was attributable to n-related sampling variance and that occurred only with highly conservative, suboptimal criterion placement.

Numerous theorists have argued that a crucial first step in investigating the psychology of an organism is to gain insight into the environment in which the organism has evolved and to which it has adapted. Brunswik (1956, p. 119) used strong phraseology in describing the analysis of "textural ecology as a propaedeutic to functional psychology," He had previously exemplified this prescription with his work on the ecological validity of the Gestalt principle of proximity (Brunswik & Kamiya, 1953). Brunswik's call for the study of the ecology has been characterized as "psychology without a subject," emphasizing the importance of studying the environment (see, e.g., Doherty, 2001). An example of this notion was introduced by Simon (1969), who described the complex behavior of an ant on a beach as a "reflection of the complexity of the environment in which it finds itself" (p. 24). Further calls for the necessity of modeling the environment have been made by J. R. Anderson (1990), Shepard (1990), and Gigerenzer and Todd (1999). As Shepard (1990, p. 213) succinctly put it, "what we are beginning to discern about the mind looks very much like a reflection of the world."

QUANTIFYING DECISION ACCURACY

It is well-known that for any given level of tolerance (a) for false positives, the power for detecting an effect increases monotonically with sample size. Thus, it is clear that large samples are better than small ones when decision accuracy is measured according to the prescriptions of null hypothesis testing. Within this prescriptive framework, it is assumed that there is a default and, thus, privileged hypothesis about some aspect of the environment. Moreover, this "null" hypothesis is rejected when a, the probability of incorrectly rejecting the null (which can be conceptualized as a false alarm rate), is less than or equal to some agreed-upon standard. The logic of null hypothesis testing typically assumes that the decision maker should be unwilling to accept a greater-than-α error rate, even though the result would be to substantially increase statistical power-that is, to increase the probability of rejecting the null hypothesis given that the hypothesis is false.

In contrast to null hypothesis testing, signal detection theory (see Macmillan & Creelman, 1991) assumes that data have been sampled from either a signal population or a noise population. It is also assumed that each datum is characterized by a particular value on an evidence scale and that the level of the evidence variable is diagnostic as to whether the datum was drawn from a signal population or a noise population. The decision maker's task is to pick a particular critical value on the evidence scale. When the evidence variable exceeds the critical value, the stimulus is judged to be a signal; otherwise, it is judged to be noise.

For example, in research on recognition memory (for a review, see Yonelinas, 2002), subjects are typically presented first with a study list and then with a recognition list that contains both studied and nonstudied items. The task is to respond "yes" or "no" to each recognition item to indicate whether that item was or was not studied, respectively. …

The rest of this article is only available to active members of Questia

Sign up now for a free, 1-day trial and receive full access to:

  • Questia's entire collection
  • Automatic bibliography creation
  • More helpful research tools like notes, citations, and highlights
  • A full archive of books and articles related to this one
  • Ad-free environment

Already a member? Log in now.

Notes for this article

Add a new note
If you are trying to select text to create highlights or citations, remember that you must now click or tap on the first word, and then click or tap on the last word.
One moment ...
Default project is now your active project.
Project items

Items saved from this article

This article has been saved
Highlights (0)
Some of your highlights are legacy items.

Highlights saved before July 30, 2012 will not be displayed on their respective source pages.

You can easily re-create the highlights by opening the book page or article, selecting the text, and clicking “Highlight.”

Citations (0)
Some of your citations are legacy items.

Any citation created before July 30, 2012 will labeled as a “Cited page.” New citations will be saved as cited passages, pages or articles.

We also added the ability to view new citations from your projects or the book or article where you created them.

Notes (0)
Bookmarks (0)

You have no saved items from this article

Project items include:
  • Saved book/article
  • Highlights
  • Quotes/citations
  • Notes
  • Bookmarks
Notes
Cite this article

Cited article

Style
Citations are available only to our active members.
Sign up now to cite pages or passages in MLA, APA and Chicago citation styles.

(Einhorn, 1992, p. 25)

(Einhorn 25)

1

1. Lois J. Einhorn, Abraham Lincoln, the Orator: Penetrating the Lincoln Legend (Westport, CT: Greenwood Press, 1992), 25, http://www.questia.com/read/27419298.

Cited article

Sample Size and the Detection of Means: A Signal Detection Account
Settings

Settings

Typeface
Text size Smaller Larger Reset View mode
Search within

Search within this article

Look up

Look up a word

  • Dictionary
  • Thesaurus
Please submit a word or phrase above.
Print this page

Print this page

Why can't I print more than one page at a time?

Help
Full screen

matching results for page

    Questia reader help

    How to highlight and cite specific passages

    1. Click or tap the first word you want to select.
    2. Click or tap the last word you want to select, and you’ll see everything in between get selected.
    3. You’ll then get a menu of options like creating a highlight or a citation from that passage of text.

    OK, got it!

    Cited passage

    Style
    Citations are available only to our active members.
    Sign up now to cite pages or passages in MLA, APA and Chicago citation styles.

    "Portraying himself as an honest, ordinary person helped Lincoln identify with his audiences." (Einhorn, 1992, p. 25).

    "Portraying himself as an honest, ordinary person helped Lincoln identify with his audiences." (Einhorn 25)

    "Portraying himself as an honest, ordinary person helped Lincoln identify with his audiences."1

    1. Lois J. Einhorn, Abraham Lincoln, the Orator: Penetrating the Lincoln Legend (Westport, CT: Greenwood Press, 1992), 25, http://www.questia.com/read/27419298.

    Cited passage

    Thanks for trying Questia!

    Please continue trying out our research tools, but please note, full functionality is available only to our active members.

    Your work will be lost once you leave this Web page.

    For full access in an ad-free environment, sign up now for a FREE, 1-day trial.

    Already a member? Log in now.