Regression-based response probing for assessing the validity of survey questions

Sturgis, Patrick, Brunton-Smith, Ian and Jackson, Jonathan ORCID: 0000-0003-2426-2219 (2020) Regression-based response probing for assessing the validity of survey questions. In: Beatty, Paul, Willis, Gordon and Padilla, Jose-Luis, (eds.) Advances in Questionnaire Design, Development, Evaluation and Testing. John Wiley & Sons, Chichester, 571- 591. ISBN 9781119263685

Text - Accepted Version Registered users only Download (459kB)

• Author

Abstract

We describe a procedure for assessing the validity of survey questions. Response probes are administered which ask respondents to say in their own words what came to mind when answering the question. The verbatim responses are coded to a frame which captures the conceptual content of the responses and are then included as predictors in a regression model, where the question that was used to elicit the verbatim responses is specified as the outcome. Controls are included so that the estimated coefficients of the model can be used to interpret whether and to what extent the different cognitive frames identified in the verbatim data align with responses to the question. The technique can be extended to include split-ballot designs, where variants of the target question are randomised across groups. We illustrate the procedure using two example questions: interpersonal trust and fear of crime.

Item Type:	Book Section
Official URL:	https://www.wiley.com/en-gb
Additional Information:	© 2020 John Wiley & Sons, Inc.
Divisions:	Methodology
Subjects:	H Social Sciences > H Social Sciences (General)
Date Deposited:	25 May 2018 12:06
Last Modified:	10 Nov 2024 19:51
URI:	http://eprints.lse.ac.uk/id/eprint/88071

Actions (login required)

View Item