Academic journal article Research Quarterly for Exercise and Sport

Coder Agreement in Scoring Physical Activity Diary Data Using the Compendium

Academic journal article Research Quarterly for Exercise and Sport

Coder Agreement in Scoring Physical Activity Diary Data Using the Compendium

Article excerpt

The compendium of physical activities (Ainsworth et al., 1993, 2000) has often been used to score dairy and/or questionnaire data, but some critical coder agreement issues, such as agreement of multiple coders and impact of the coding scale/system, have not yet been addressed. The purpose of this study was to examine multiple-coder agreement in scoring physical activity data using the Compendium. Six coders were recruited for the study. After they were trained to code diaries using the Compendium, they were asked to code a culled 200-case diary. This training diary was created from a large diary database (N = 22,371 cases) and had been rated by a group panel. The coders' agreements with the panel were then computed and another 200-case dataset would be used if the agreement was lower than 80%. All of them passed 200-case coding training. They were then asked to code a 500-case dataset, which was developed from 5 participants' diaries with 100 cases drawn randomly from each. Each case was rated by the coders and their agreements by a specific activity (called "description" in the compendium) and by a category (called "heading") were computed using Fleiss' generalized Kappa (Fleiss, 1971). A total of 106 specific activity and 15 category labels were employed in rating the diary cases. The overall agreement (Fleiss' Kappa) for specific activity was . …

Search by... Author
Show... All Results Primary Sources Peer-reviewed

Oops!

An unknown error has occurred. Please click the button below to reload the page. If the problem persists, please try again in a little while.