Cookies?
Library Header Image
LSE Research Online LSE Library Services

The effect of probing "don't know" responses on measurement quality and nonresponse in surveys

Kuha, Jouni and Butt, Sarah and Katsikatsou, Myrsini and Skinner, Chris J. (2017) The effect of probing "don't know" responses on measurement quality and nonresponse in surveys. Journal of the American Statistical Association. ISSN 0162-1459

[img] PDF - Accepted Version
Restricted to Repository staff only

Download (416kB) | Request a copy

Identification Number: 10.1080/01621459.2017.1323640

Abstract

In survey interviews, "Don't know" (DK) responses are commonly treated as missing data. One way to reduce the rate of such responses is to probe initial DK answers with a follow-up question designed to encourage respondents to give substantive, non-DK responses. However, such probing can also reduce data quality by introducing additional or differential measurement error. We propose a latent variable model for analyzing the effects of probing on responses to survey questions. The model makes it possible to separate measurement effects of probing from true differences between respondents who do and do not require probing. We analyze new data from an experiment which compared responses to two multi-item batteries of questions with and without probing. In this study, probing reduced the rate of DK responses by around a half. However, it also had substantial measurement effects, in that probed answers were often weaker measures of constructs of interest than were unprobed answers. These effects were larger for questions on attitudes than for pseudo-knowledge questions on perceptions of external facts. The results provide evidence against the use of probing of "Don't know" responses, at least for the kinds of items and respondents considered in this study.

Item Type: Article
Official URL: http://www.tandfonline.com/toc/uasa20/current
Additional Information: © 2017 American Statistical Association
Subjects: Q Science > QA Mathematics
Sets: Departments > Methodology
Departments > Statistics
Date Deposited: 21 Apr 2017 13:48
Last Modified: 19 Sep 2017 13:56
Projects: 262208
Funders: UK National Centre for Research Methods under its program of Methodological Innovation Projects, European Union under European Union under Framework Programme 7
URI: http://eprints.lse.ac.uk/id/eprint/74130

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics