Kibuchi, Eliud, Sturgis, Patrick ORCID: 0000-0003-1180-3493, Durrant, Gabriele B. and Maslovskaya, Olga (2024) The efficacy of propensity score matching for separating selection and measurement effects across different survey modes. Journal of Survey Statistics and Methodology, 12 (3). 764 - 789. ISSN 2325-0984
Text (Kibuchi_et_al__Efficacy-of-propensity-score-matching--published)
- Published Version
Available under License Creative Commons Attribution. Download (1MB) |
Abstract
Effective evaluation of data quality between data collected in different modes is complicated by the confounding of selection and measurement effects. This study evaluates the utility of propensity score matching (PSM) as a method that has been proposed as a means of removing selection effects across surveys conducted in different modes. Our results show large differences in estimates for the same variables between parallel face-to-face and online surveys, even after matching on standard demographic variables. Moreover, discrepancies in estimates are still present after matching between surveys conducted in the same (online) mode, where differences in measurement properties can be ruled out a priori. Our findings suggest that PSM has substantial limitations as a method for separating measurement and selection differences across modes and should be used only with caution.
Item Type: | Article |
---|---|
Official URL: | https://academic.oup.com/jssam |
Additional Information: | © 2024 The Authors |
Divisions: | Methodology |
Subjects: | H Social Sciences > HA Statistics |
Date Deposited: | 28 Feb 2024 14:18 |
Last Modified: | 08 Nov 2024 18:06 |
URI: | http://eprints.lse.ac.uk/id/eprint/122120 |
Actions (login required)
View Item |