# Applications of Information Theory to Psychology: A Summary of Basic Concepts, Methods, and Results

By Fred Attneave | Go to book overview

Appendix I
The Calculation of Information Measures from Variance Statistics

The correlation coefficient, r, the correlation ratio, η (eta), and the transmission function, T, are alike in that all three are measures of relatedness. T is the most general of the three, since it may be calculated for any transmission matrix of the sort shown in Table 3 (p. 45), whether the variables are ordered --that is, whether adjacent categories represent successive steps on a continuum--or not. When the variables are ordered, but not related in a linear manner, either T or η may be calculated, and when a linear relationship holds, either T, η, or r may be. In the last case, η and r will be equal, or very nearly so: the square of either may be interpreted as the proportion of the variance of y which is predicted, or accounted for, by x. But how is T related to r and η? This relationship has a practical importance as well as a theoretical interest. The stability of a sample value of r (or of η, though to a lesser degree) is much greater than that of T + ̂, because T + ̂ involves many more degrees of freedom; therefore, if we had a matrix containing many cells and relatively few observations, and a linear relationship held between the variables, an estimate of T calculated from r might be considerably more accurate than one calculated by the use of the Shannon-Wiener measure.

Now, it may be shown (see Shannon [79] pp. 54-56) that the uncertainty associated with a normal distribution is

(54)

Here H has the meaning with which we are familiar if the unit in which σ is expressed is the "width" of one category, or alternative, along the continuum. Formula (54) may be re-

-95-

If you are trying to select text to create highlights or citations, remember that you must now click or tap on the first word, and then click or tap on the last word.
One moment ...
Default project is now your active project.
Project items
Notes

#### Cited page

Style
Citations are available only to our active members.
Buy instant access to cite pages or passages in MLA 8, MLA 7, APA and Chicago citation styles.

(Einhorn, 1992, p. 25)

(Einhorn 25)

(Einhorn 25)

1. Lois J. Einhorn, Abraham Lincoln, the Orator: Penetrating the Lincoln Legend (Westport, CT: Greenwood Press, 1992), 25, http://www.questia.com/read/27419298.

#### Cited page

Applications of Information Theory to Psychology: A Summary of Basic Concepts, Methods, and Results

Settings

#### Settings

Typeface
Text size Reset View mode
Search within

Look up

#### Look up a word

• Dictionary
• Thesaurus
Please submit a word or phrase above.

Why can't I print more than one page at a time?

Help
Full screen
Items saved from this book
• Bookmarks
• Highlights & Notes
• Citations
/ 122

### How to highlight and cite specific passages

1. Click or tap the first word you want to select.
2. Click or tap the last word you want to select, and you’ll see everything in between get selected.
3. You’ll then get a menu of options like creating a highlight or a citation from that passage of text.

## Cited passage

Style
Citations are available only to our active members.
Buy instant access to cite pages or passages in MLA 8, MLA 7, APA and Chicago citation styles.

"Portraying himself as an honest, ordinary person helped Lincoln identify with his audiences." (Einhorn, 1992, p. 25).

"Portraying himself as an honest, ordinary person helped Lincoln identify with his audiences." (Einhorn 25)

"Portraying himself as an honest, ordinary person helped Lincoln identify with his audiences." (Einhorn 25)

"Portraying himself as an honest, ordinary person helped Lincoln identify with his audiences."1

1. Lois J. Einhorn, Abraham Lincoln, the Orator: Penetrating the Lincoln Legend (Westport, CT: Greenwood Press, 1992), 25, http://www.questia.com/read/27419298.

## Thanks for trying Questia!

Please continue trying out our research tools, but please note, full functionality is available only to our active members.

Your work will be lost once you leave this Web page.