The efficacy of propensity score matching for separating selection and measurement effects across different survey modes

Kibuchi, Eliud, Sturgis, Patrick ORCID: 0000-0003-1180-3493, Durrant, Gabriele B. and Maslovskaya, Olga (2024) The efficacy of propensity score matching for separating selection and measurement effects across different survey modes. Journal of Survey Statistics and Methodology, 12 (3). 764 - 789. ISSN 2325-0984

Text (Kibuchi_et_al__Efficacy-of-propensity-score-matching--published) - Published Version Available under License Creative Commons Attribution. Download (1MB)

• Author
• Scopus publication

Abstract

Effective evaluation of data quality between data collected in different modes is complicated by the confounding of selection and measurement effects. This study evaluates the utility of propensity score matching (PSM) as a method that has been proposed as a means of removing selection effects across surveys conducted in different modes. Our results show large differences in estimates for the same variables between parallel face-to-face and online surveys, even after matching on standard demographic variables. Moreover, discrepancies in estimates are still present after matching between surveys conducted in the same (online) mode, where differences in measurement properties can be ruled out a priori. Our findings suggest that PSM has substantial limitations as a method for separating measurement and selection differences across modes and should be used only with caution.

Item Type:	Article
Official URL:	https://academic.oup.com/jssam
Additional Information:	© 2024 The Authors
Divisions:	Methodology
Subjects:	H Social Sciences > HA Statistics
Date Deposited:	28 Feb 2024 14:18
Last Modified:	12 Dec 2024 04:04
URI:	http://eprints.lse.ac.uk/id/eprint/122120

Actions (login required)

View Item