Learning from null effects: a bottom-up approach

Alrababa'h, Ala', Williamson, Scott, Dillon, Andrea, Hainmueller, Jens, Hangartner, Dominik, Hotard, Michael, Laitin, David, Lawrence, Duncan and Weinstein, Jeremy (2023) Learning from null effects: a bottom-up approach. Political Analysis, 31 (3). 448 - 456. ISSN 1047-1987

Text (Hangartner_learning-from-null-effects--published) - Published Version Available under License Creative Commons Attribution Non-commercial Share Alike. Download (265kB)

• Author
• Scopus publication

Abstract

A critical barrier to generating cumulative knowledge in political science and related disciplines is the inability of researchers to observe the results from the full set of research designs that scholars have conceptualized, implemented, and analyzed. For a variety of reasons, studies that produce null findings are especially likely to be unobserved, creating biases in publicly accessible research. While several approaches have been suggested to overcome this problem, none have yet proven adequate. We call for the establishment of a new discipline-wide norm in which scholars post short “null results reports” online that summarize their research designs, findings, and interpretations. To address the inevitable incentive problems that earlier proposals for reform were unable to overcome, we argue that decentralized research communities can spur the broader disciplinary norm change that would bring advantage to scientific advance. To facilitate our contribution, we offer a template for these reports that incorporates evaluation of the possible explanations for the null findings, including statistical power, measurement strategy, implementation issues, spillover/contamination, and flaws in theoretical priors. We illustrate the template’s utility with two experimental studies focused on the naturalization of immigrants in the United States and attitudes toward Syrian refugees in Jordan.

Item Type:	Article
Official URL:	https://www.cambridge.org/core/journals/political-...
Additional Information:	© 2022 The Authors
Divisions:	Government
Subjects:	J Political Science > JC Political theory
Date Deposited:	21 Dec 2021 14:03
Last Modified:	12 Dec 2024 02:47
URI:	http://eprints.lse.ac.uk/id/eprint/113009

Actions (login required)

View Item