Extending the Forer Test beyond Face Validity: An Experiential Approach to Teaching Social Science Methodology
Betts, Stephen C., Taran, Zinaida, Academy of Educational Leadership Journal
Students studying social science methodology have difficulty understanding the concept of validity beyond the face validity. Several generations of psychology students have taken the 'Forer Test' and learned not to rely on face validity. In the 'Forer Test' every participant gets the same personality profile after taking a personality test. Under the impression that it is a personalized profile, most participants consider the 'results' to be fairly accurate. In this exercise, the Forer Test is used as a catalyst for examining additional validity concepts. We use social science analytical methods on the data collected from the 'personality test' to see if indeed they reveal patterns that indicate latent constructs. In this paper we describe the basic exercise, and illustrate how it was successfully used in undergraduate and graduate management and marketing courses.
Many psychology students are familiar with the 'Forer Test'. In the test, a personality evaluation is administered and every participant gets the same personality profile as a result (Forer, 1949; Carroll, 2005). Most participants consider the profile to be fairly accurate, thinking it is a personalized profile based on the test. This face validity is due to the generally positive nature of the profile (Leung, Su & Morris, 2001), the accepted authority of the evaluator and the belief that the analysis was unique to them (Hannay, Arisholm, Engvik & Sjoberg, 2010; Dickson & Kelly, 1985). The test is used to show the problems with relying only on face validity to judge a measurement instrument or evaluation. In this exercise we go beyond the traditional 'Forer Test' lesson. We administer the 'personality test' online, and analyze the actual results from test using legitimate, established social science methods to see if indeed the test does reveal patterns that indicate latent constructs. In this way, an interesting but limited demonstration of a psychological phenomenon is used as a starting point for illustrating more sophisticated concepts. In addition to describing the basic exercise, we illustrate how it can be used in different but related behavioral disciplines within business education. Specifically we describe the basic exercise, and illustrate how it was successfully used in undergraduate and graduate management and marketing courses.
The paper begins with a description of the Forer test, its history and application. This is followed by a brief explanation of experiential exercises in general. A description of our exercise is presented next. After the basic exercise is presented, a specific implementation of the exercise will be examined in detail. The materials and procedures will be presented first, followed by the analysis methods and results. The presentation of the results in class and the ensuing discussion are explored next. The paper concludes with proposals of how to modify the exercise for different contexts.
BACKGROUND - THE FORER TEST
In 1949 Bertram R. Forer introduced "the fallacy of personal validation". Specifically he found that people had a tendency to accept vague, general descriptions of personality as very true for them even though the descriptions could apply to almost everyone. The personality evaluation given by Forer was as follows:
"You have a need for other people to like and admire you, and yet you tend to be critical of yourself. While you have some personality weaknesses you are generally able to compensate for them. You have considerable unused capacity that you have not turned to your advantage. Disciplined and self-controlled on the outside, you tend to be worrisome and insecure on the inside. At times you have serious doubts as to whether you have made the right decision or done the right thing. You prefer a certain amount of change and variety and become dissatisfied when hemmed in by restrictions and limitations. You also pride yourself as an independent thinker; and do not accept others* statements without satisfactory proof. …