Multi-studies: a novel approach to addressing irreplicability in RCTs

Krauss, Alexander ORCID: 0000-0002-1783-2765 (2024) Multi-studies: a novel approach to addressing irreplicability in RCTs. In: A Medical Educator's Guide to Thinking Critically about Randomised Controlled Trials: Deconstructing the "Gold Standard". Springer International (Firm), pp. 163-180. ISBN 9783031258589

Full text not available from this repository.

• Scopus publication

Abstract

This chapter proposes a novel approach to addressing irreplicability encountered in randomised controlled trials (RCTs). Irreplicability affects, to different degrees, all fields of science. Some of the most common explanations for non-replicability are low sample size, low statistical power, p-hacking, publication bias and HARKing. Such issues face some studies but not others. Focusing on RCTs, this chapter highlights that, while it is well-recognised that many types of bias and other types of constraint generally face studies across the biomedical, behavioural and social sciences, they are not commonly discussed collectively. In response to this gap in the literature on RCTs, we shall consider a novel approach to addressing non-replicability. The chapter helps explain how a degree of inevitable variation between the outcomes of different studies is driven by a combined set of biases and constraints underlying the scientific process that relate to methods, people, contexts, and time points at which data are collected in studies. It outlines how causal evidence in such studies is inferred from estimated statistical results that are the outcome of multiple complex processes: sampling, randomising, blinding, controlling, delivering treat-ments, and so on. These processes involve many actors making many decisions at different steps when designing, implementing and analysing studies within a partic-ular context and time period. Correspondingly, the chapter considers the influence of the combined set of constraints on the quality and replicability of RCTs, and how to better tackle this issue. This entails integrating comparability of groups, treatments, contexts, etc. within a single study-called here a multi-study. Implications are then drawn for practitioners.

Item Type:	Book Section
Additional Information:	© The Editor(s) (if applicable) and The Author(s).
Divisions:	LSE
Subjects:	R Medicine Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Date Deposited:	11 Oct 2024 10:21
Last Modified:	11 Dec 2024 18:15
URI:	http://eprints.lse.ac.uk/id/eprint/125691

Actions (login required)

View Item