Library Header Image
LSE Research Online LSE Library Services

Regression-based response probing for assessing the validity of survey questions

Sturgis, Patrick, Brunton-Smith, Ian and Jackson, Jonathan ORCID: 0000-0003-2426-2219 (2020) Regression-based response probing for assessing the validity of survey questions. In: Beatty, Paul, Willis, Gordon and Padilla, Jose-Luis, (eds.) Advances in Questionnaire Design, Development, Evaluation and Testing. John Wiley & Sons, Chichester, 571- 591. ISBN 9781119263685

[img] Text - Accepted Version
Registered users only

Download (459kB) | Request a copy

Identification Number: 10.1002/9781119263685.ch23


We describe a procedure for assessing the validity of survey questions. Response probes are administered which ask respondents to say in their own words what came to mind when answering the question. The verbatim responses are coded to a frame which captures the conceptual content of the responses and are then included as predictors in a regression model, where the question that was used to elicit the verbatim responses is specified as the outcome. Controls are included so that the estimated coefficients of the model can be used to interpret whether and to what extent the different cognitive frames identified in the verbatim data align with responses to the question. The technique can be extended to include split-ballot designs, where variants of the target question are randomised across groups. We illustrate the procedure using two example questions: interpersonal trust and fear of crime.

Item Type: Book Section
Official URL:
Additional Information: © 2020 John Wiley & Sons, Inc.
Divisions: Methodology
Subjects: H Social Sciences > H Social Sciences (General)
Date Deposited: 25 May 2018 12:06
Last Modified: 20 Oct 2021 01:20

Actions (login required)

View Item View Item


Downloads per month over past year

View more statistics