Academic journal article
By Steele, Jennifer; Bourke, Lisa; Luloff, A. E.; Liao, Pei-Shan; Theodori, Gene L.; Krannich, Richard S.
Journal of the Community Development Society , Vol. 32, No. 2
The hand delivery of self-administered questionnaires has been presented as an alternative for reducing non-coverage error associated with the mail method at lower cost than face-to-face interviews. This research note draws from experiences using the hand delivery technique (combined with hand retrieval) in rural and small community studies to address practical issues associated with improving coverage, and its relationships with sampling, response, and administrative considerations. It is suggested that while this technique provides needed flexibility in relation to household enumeration options, logistical issues limit its applicability where settlement patterns are dispersed and resources to supplement sampling frames are inadequate. Time and cost outlays are required to maximize its potential. When place-related and administrative conditions can be met, the technique offers promise for reducing non-coverage error and possible sample bias without sacrificing response rates. In addition, it provides opportunities to gain experiential insights not possible with other survey methods.
Researchers often employ general public survey methods for community studies and other inquiries that focus on geographically defined populations. The ability to utilize questionnaire-derived data on individuals and households for analyzing relationships with community factors is dependent upon acceptably low error in relation to coverage, sampling, measurement, and response (Dillman, 1991, 2000; Groves, 1989). Non-response problems associated with the telephone method have increased the importance of mail, but the latter presents unique challenges in relation to coverage. The hand delivery of self-administered questionnaires has been presented as an alternative for reducing non-coverage error at lower cost than has been the case with face-to-face interviews (Dillman, 1991; Melevin et al., 1999).
This research note draws from experiences using the hand delivery method in rural and small community studies to address practical issues associated with improving coverage, and its relationships with sampling, response, and administrative considerations. (1) Insights are drawn primarily from recent experience with the technique in Pennsylvania, but also from studies conducted in the Great Plains and Intermountain West states (Bourke, 1994; Krannich & Albrecht, 1995; Krannich, Greider, & Little, 1985; Krannich & Little, 1989; Murdock et al., 1999). In all these studies, hand delivery was combined with hand retrieval (drop-off/pick-up).
This note is organized as follows. First, the challenges associated with telephone and mail methods are discussed in order to frame the role of the drop-off/pick-up technique. Second, household enumeration options and field experiences are reviewed in order to highlight practical considerations involved with improving coverage. Third, potential advantages of the technique in relation to reducing sample bias are discussed in the context of insights gained through field experiences. Next, response rates obtained in the Pennsylvania study are presented using alternative calculations to demonstrate the success of the drop-off/pick-up method for collecting data on the designated sample. Fifth, administrative considerations are discussed and survey error evaluated in relation to costs. The note concludes with a summary of the utility of the drop-off/pick-up method for rural and small community studies.
CHALLENGES ASSOCIATED WITH TELEPHONE AND MAIL METHODS
Telephone interviews can offer advantages in relation to sampling frame availability and quality and efficiency of data collection. The primary challenge associated with this method is declining response rates (Dillman, 2000; Groves & Couper, 1998; Hox & DeLeeuw, 1994). Such declines increase the probability of non-response error (non-random differences between respondents and non-respondents that could be correlated with variables in the survey). …