Cookies?
Library Header Image
LSE Research Online LSE Library Services

Testing exchangeability: fork-convexity, supermartingales and e-processes

Ramdas, Aaditya, Ruf, Johannes, Larsson, Martin and M. Koolen, Wouter (2021) Testing exchangeability: fork-convexity, supermartingales and e-processes. International Journal of Approximate Reasoning. ISSN 0888-613X (In Press)

[img] Text (test_binary) - Published Version
Pending embargo until 1 January 2100.

Download (2MB) | Request a copy

Abstract

Suppose we observe an infinite series of coin flips X1, X2, . . ., and wish to sequentially test the null that these binary random variables are exchangeable. Nonnegative supermartingales (NSMs) are a workhorse of sequential inference, but we prove that they are powerless for this problem. First, utilizing a geometric concept called fork-convexity (a sequential analog of convexity), we show that any process that is an NSM under two distributions, is also necessarily an NSM under their “fork-convex hull”. Second, we demonstrate that the fork-convex hull of the exchangeable null consists of all possible laws over binary sequences; this implies that any NSM under exchangeability is necessarily nonincreasing, hence always yields a powerless test for any alternative. Since testing arbitrary deviations from exchangeability is information theoretically impossible, we focus on Markovian alternatives. We combine ideas from universal inference and the method of mixtures to derive a “safe e-process”, which is a nonnegative process with expectation at most one under the null at any stopping time, and is upper bounded by a martingale, but is not itself an NSM. This in turn yields a level α sequential test that is consistent; regret bounds from universal coding also demonstrate rate-optimal power. We present ways to extend these results to any finite alphabet and to Markovian alternatives of any order using a “double mixture” approach. We provide a wide array of simulations, and give general approaches based on betting for unstructured or ill-specified alternatives. Finally, inspired by Shafer, Vovk, and Ville, we provide game-theoretic interpretations of our e-processes and pathwise results.

Item Type: Article
Official URL: https://www.sciencedirect.com/journal/internationa...
Additional Information: © 2021 Elsevier Inc
Divisions: Mathematics
Subjects: Q Science > QA Mathematics
Date Deposited: 02 Jul 2021 09:03
Last Modified: 30 Jul 2021 14:45
URI: http://eprints.lse.ac.uk/id/eprint/110967

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics