The efficacy of propensity score matching for separating selection and measurement effects across different survey modes

Kibuchi, Eliud, Sturgis, Patrick ORCID: 0000-0003-1180-3493, Durrant, Gabriele B. and Maslovskaya, Olga (2024) The efficacy of propensity score matching for separating selection and measurement effects across different survey modes. Journal of Survey Statistics and Methodology. ISSN 2325-0984 (In Press)

Text (The efficacy of propensity score matching for separating selection and measurement effects across different survey modes) - Accepted Version Pending embargo until 1 January 2100. Download (798kB) | Request a copy

• Author

Abstract

Effective evaluation of data quality between data collected in different modes is complicated by the confounding of selection and measurement effects. This study evaluates the utility of propensity score matching (PSM) as a method that has been proposed as a means of removing selection effects across surveys conducted in different modes. Our results show large differences in estimates for the same variables between parallel face-to-face and online surveys, even after matching on standard demographic variables. Moreover, discrepancies in estimates are still present after matching between surveys conducted in the same (online) mode, where differences in measurement properties can be ruled out a priori. Our findings suggest that PSM has substantial limitations as a method for separating measurement and selection differences across modes and should be used only with caution.

Item Type:	Article
Official URL:	https://academic.oup.com/jssam
Additional Information:	© 2024 Oxford University Press
Divisions:	Methodology
Subjects:	H Social Sciences > HA Statistics
Date Deposited:	28 Feb 2024 14:18
Last Modified:	28 Mar 2024 10:12
URI:	http://eprints.lse.ac.uk/id/eprint/122120

Actions (login required)

View Item