Separation and rare events

Beiser-McGrath, Liam F. ORCID: 0000-0001-9745-0320 (2020) Separation and rare events. Political Science Research and Methods, 10 (2). 428 - 437. ISSN 2049-8470

Text (Beiser-McGrath_separation-and-rare-events--published) - Published Version Available under License Creative Commons Attribution Non-commercial Share Alike. Download (409kB)

• Author

Abstract

When separation is a problem in binary dependent variable models, many researchers use Firth's penalized maximum likelihood in order to obtain finite estimates (Firth, 1993; Zorn, 2005; Rainey, 2016). In this paper, I show that this approach can lead to inferences in the opposite direction of the separation when the number of observations are sufficiently large and both the dependent and independent variables are rare events. As large datasets with rare events are frequently used in political science, such as dyadic data measuring interstate relations, a lack of awareness of this problem may lead to inferential issues. Simulations and an empirical illustration show that the use of independent weakly-informative prior distributions centered at zero, for example, the Cauchy prior suggested by Gelman et al. (2008), can avoid this issue. More generally, the results caution researchers to be aware of how the choice of prior interacts with the structure of their data, when estimating models in the presence of separation.

Item Type:	Article
Official URL:	https://www.cambridge.org/core/journals/political-...
Additional Information:	© 2020 The Author
Divisions:	LSE
Subjects:	J Political Science > JA Political science (General) H Social Sciences > HA Statistics
Date Deposited:	31 Oct 2022 15:21
Last Modified:	09 Nov 2024 22:39
URI:	http://eprints.lse.ac.uk/id/eprint/117222

Actions (login required)

View Item