Naci, Huseyin 
ORCID: 0000-0002-7192-5751 and Soumerai, Stephen B.
(2016)
History bias, study design, and the unfulfilled promise of pay-for-performance policies in health care.
Preventing Chronic Disease, 13 (160133).
pp. 1-7.
ISSN 1545-1151
|
PDF
- Published Version
Download (420kB) | Preview |
Abstract
Recently, PCD published a longer, related article, “How Do You Know Which Health Care Effectiveness Research You Can Trust? A Guide for the Perplexed,” that was translational in nature. The article used simple graphs and easy-to-understand text—in five case studies—to illustrate how powerful biases, combined with weak study designs that cannot control for them, can yield untrustworthy research on several widespread interventions: influenza vaccination policy, health information technology, drug safety, prevention of childhood obesity and hospital safety (“mortality reduction”) programs. Since this was not a formal methods paper, the target audiences were policy makers, journalists, trainees, and the public. The primary goal was to understand how weak or strong study designs are likely to fail or succeed in controlling for these pervasive biases. At the start of that article, we promised to add to these case examples of common biases and research designs to show why “caution is needed in understanding and accepting the results of research that may have profound and long-lasting effects on health policy and clinical practice.” In this sixth case study, the authors revisit one of the most common and virulent biases, threats of history. Studies can mislead policymakers and clinicians because they fail to control for history, which represents pre-existing or co-occurring changes in study outcomes that were happening with or without the intervention. The policy in this case, pay-for-performance (PfP, see below), is extremely sensitive to this powerful bias because medical practice is always changing as a result of factors unrelated to a policy, such as widespread media or national guidelines supporting a life-saving treatment, e.g., beta blockers for acute MI (1). Without investigating and visualizing outcomes over time before and after a policy or intervention, it is likely that the investigators will attribute such ongoing changes to “effects” of the quality improvement policy, resulting in millions of dollars of waste implementing ineffective PfP policies worldwide.
| Item Type: | Article |
|---|---|
| Official URL: | http://www.cdc.gov/pcd/ |
| Additional Information: | © 2016 United States Government |
| Divisions: | Social Policy LSE Health |
| Subjects: | R Medicine > RA Public aspects of medicine > RA0421 Public health. Hygiene. Preventive Medicine |
| Date Deposited: | 21 Apr 2016 08:33 |
| Last Modified: | 14 Nov 2024 19:06 |
| URI: | http://eprints.lse.ac.uk/id/eprint/66195 |
Actions (login required)
 |
View Item |
Download Statistics
Download Statistics