Cookies?
Library Header Image
LSE Research Online LSE Library Services

Regression-based response probing for assessing the validity of survey questions

Sturgis, Patrick and Brunton-Smith, Ian and Jackson, Jonathan (2018) Regression-based response probing for assessing the validity of survey questions. In: Beatty, Paul and Willis, Gordon and Padilla, Jose-Luis, (eds.) Question design testing and evaluation. Wiley, Chichester. (In Press)

[img] Text - Accepted Version
Restricted to Repository staff only

Download (459kB) | Request a copy

Abstract

We describe a procedure for assessing the validity of survey questions. Response probes are administered which ask respondents to say in their own words what came to mind when answering the question. The verbatim responses are coded to a frame which captures the conceptual content of the responses and are then included as predictors in a regression model, where the question that was used to elicit the verbatim responses is specified as the outcome. Controls are included so that the estimated coefficients of the model can be used to interpret whether and to what extent the different cognitive frames identified in the verbatim data align with responses to the question. The technique can be extended to include split-ballot designs, where variants of the target question are randomised across groups. We illustrate the procedure using two example questions: interpersonal trust and fear of crime.

Item Type: Book Section
Official URL: https://www.wiley.com/en-gb
Additional Information: © 2018 John Wiley & Sons, Inc
Divisions: Methodology
Subjects: H Social Sciences > H Social Sciences (General)
Sets: Departments > Methodology
Date Deposited: 25 May 2018 12:06
Last Modified: 25 May 2018 12:12
URI: http://eprints.lse.ac.uk/id/eprint/88071

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics