# A Handbook for Data Analysis in the Behavioral Sciences: Statistical Issues

By Gideon Keren; Charles Lewis | Go to book overview

3 Analyzing Means from Repeated Measures Data

Charles Lewis Educational Testing Service

Suppose you were reading a journal article describing the results of a repeated measures experiment and you cam across statements such as "the main effect of Alternation Rate was marginally significant, F(5, 115) = 2.06, p < .08, and the Playing Speed × Alternation Rate interaction was reliable, F(5, 115) = 3.48, p < .01. . . . The main effect of Playing Speed [was not] significant . . . F(1, 23) = 2.56, ns" ( Samuel, 1991, p. 396).1 Leaving aside any substantive interpretation of these effects, what would your reaction be to the statistical information that has been given? (For completeness, it should be noted that the 2 × 6 cell means that are being compared in the analysis are also plotted in an accompanying figure.)

To focus attention on the object of concern, suppose the reported p values were changed as follows: for Alternation Rate, from <.08 (actually .075) to .165; for the interaction, from <.01 (actually .006) to .075; and for Playing Speed, no change (current value .123). Would your reaction to the results change at all? The author would apparently now identify both main effects as ns, and the interaction as marginally significant. The same sort of changes could be made for the p values associated with any standard F test of a main effect or interaction involving a repeated measures factor with three or more levels. But wait a moment! Where did these new p values come from and what do they represent?

Almost 40 years ago, Box ( 1954) pointed out that correlated observations in the analysis of variance can have an impact on the probability of a Type I error for any F test used to test hypotheses about means. One place where correlated

____________________
1
Here 24 subjects provided data (percent correct scores) for a matching task in each of the 12 conditions defined by the combinations of 2 levels of Playing Speed and 6 levels of Alternation Rate.

-73-

If you are trying to select text to create highlights or citations, remember that you must now click or tap on the first word, and then click or tap on the last word.
One moment ...
Project items
Notes

#### Cited page

Style
Citations are available only to our active members.
Sign up now to cite pages or passages in MLA, APA and Chicago citation styles.

#### Cited page

A Handbook for Data Analysis in the Behavioral Sciences: Statistical Issues

Settings

Typeface
Text size
Search within

Look up

#### Look up a word

• Dictionary
• Thesaurus
Please submit a word or phrase above.

Why can't I print more than one page at a time?

While we understand printed pages are helpful to our users, this limitation is necessary to help protect our publishers' copyrighted material and prevent its unlawful distribution. We are sorry for any inconvenience.
Full screen
/ 540

## Cited passage

Style
Citations are available only to our active members.
Sign up now to cite pages or passages in MLA, APA and Chicago citation styles.

## Welcome to the new Questia Reader

The Questia Reader has been updated to provide you with an even better online reading experience.  It is now 100% Responsive, which means you can read our books and articles on any sized device you wish.  All of your favorite tools like notes, highlights, and citations are still here, but the way you select text has been updated to be easier to use, especially on touchscreen devices.  Here's how:

1. Click or tap the first word you want to select.
2. Click or tap the last word you want to select.

## Thanks for trying Questia!

Please continue trying out our research tools, but please note, full functionality is available only to our active members.

Your work will be lost once you leave this Web page.