Cookies?
Library Header Image
LSE Research Online LSE Library Services

A new experiment on the use of images to answer web survey questions

Bosch Jover, Oriol, Revilla, Melanie, Qureshi, Danish Daniel and Höhne, Jan (2022) A new experiment on the use of images to answer web survey questions. Journal of the Royal Statistical Society. Series A: Statistics in Society. ISSN 0964-1998

[img] Text (Bosch-Jover_new-experiment-on-use-of-images--published) - Published Version
Available under License Creative Commons Attribution.

Download (569kB)

Identification Number: 10.1111/rssa.12856

Abstract

Images might provide richer and more objective information than text answers to open-ended survey questions. Little is known, nonetheless, about the consequences for data quality of asking participants to answer open-ended questions with images. Therefore, this paper addresses three research questions: (1) What is the effect of answering web survey questions with images instead of text on breakoff, noncompliance with the task, completion time and question evaluation? (2) What is the effect of including a motivational message on these four aspects? (3) Does the impact of asking to answer with images instead of text vary across device types? To answer these questions, we implemented a 2 × 3 between-subject web survey experiment (N = 3043) in Germany. Half of the sample was required to answer using PCs and the other half with smartphones. Within each device group, respondents were randomly assigned to (1) a control group answering open-ended questions with text; (2) a treatment group answering open-ended questions with images; and (3) another treatment group answering open-ended questions with images but prompted with a motivational message. Results show that asking participants to answer with images significantly increases participants' likelihood of noncompliance as well as their completion times, while worsening their overall survey experience. Including motivational messages, moreover, moderately reduces the likelihood of noncompliance. Finally, the likelihood of noncompliance is similar across devices.

Item Type: Article
Official URL: https://rss.onlinelibrary.wiley.com/journal/146798...
Additional Information: © 2022 The Authors Funding Information: German Science Foundation, through the Collaborative Research Center 884 “Political Economyof Reforms”, 139943784; European Research Council (ERC) under the European Unions Horizon 2020 research and innovation programme, 849165 Funding information Publisher Copyright: © 2022 The Authors. Journal of the Royal Statistical Society: Series A (Statistics in Society) published by John Wiley & Sons Ltd on behalf of Royal Statistical Society.
Divisions: Methodology
Subjects: H Social Sciences > HA Statistics
B Philosophy. Psychology. Religion > BF Psychology
H Social Sciences > H Social Sciences (General)
Date Deposited: 13 Apr 2022 16:48
Last Modified: 14 Jun 2022 08:57
URI: http://eprints.lse.ac.uk/id/eprint/114899

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics