Demonstrating the value of larger ensembles in forecasting physical systems

Machete, Reason L. and Smith, Leonard A. (2016) Demonstrating the value of larger ensembles in forecasting physical systems. Tellus Series A: Dynamic Meteorology and Oceanography, 68. ISSN 0280-6495

Preview

PDF - Published Version Available under License Creative Commons Attribution. Download (2MB) | Preview

• Author

Abstract

Ensemble simulation propagates a collection of initial states forward in time in a Monte Carlo fashion. Depending on the fidelity of the model and the properties of the initial ensemble, the goal of ensemble simulation can range from merely quantifying variations in the sensitivity of the model all the way to providing actionable probability forecasts of the future. Whatever the goal is, success depends on the properties of the ensemble, and there is a longstanding discussion in meteorology as to the size of initial condition ensemble most appropriate for Numerical Weather Prediction. In terms of resource allocation: how is one to divide finite computing resources between model complexity, ensemble size, data assimilation and other components of the forecast system. One wishes to avoid undersampling information available from the model’s dynamics, yet one also wishes to use the highest fidelity model available. Arguably, a higher fidelity model can better exploit a larger ensemble; nevertheless it is often suggested that a relatively small ensemble, say ~16 members, is sufficient and that larger ensembles are not an effective investment of resources. This claim is shown to be dubious when the goal is probabilistic forecasting, even in settings where the forecast model is informative but imperfect. Probability forecasts for a ‘simple’ physical system are evaluated at different lead times; ensembles of up to 256 members are considered. The pure density estimation context (where ensemble members are drawn from the same underlying distribution as the target) differs from the forecasting context, where one is given a high fidelity (but imperfect) model. In the forecasting context, the information provided by additional members depends also on the fidelity of the model, the ensemble formation scheme (data assimilation), the ensemble interpretation and the nature of the observational noise. The effect of increasing the ensemble size is quantified by its relative information content (in bits) using a proper skill score. Doubling the ensemble size is demonstrated to yield a non-trivial increase in the information content (forecast skill) for an ensemble with well over 16 members; this result stands in forecasting a mathematical system and a physical system. Indeed, even at the largest ensemble sizes considered (128 and 256), there are lead times where the forecast information is still increasing with ensemble size. Ultimately, model error will limit the value of ever larger ensembles. No support is found, however, for limiting design studies to the sizes commonly found in seasonal and climate studies. It is suggested that ensemble size be considered more explicitly in future design studies of forecast systems on all time scales.

Item Type:	Article
Official URL:	http://www.tellusa.net/index.php/tellusa/index
Additional Information:	© 2016 The Authors © CC BY 4.0
Divisions:	Centre for Analysis of Time Series
Subjects:	G Geography. Anthropology. Recreation > GE Environmental Sciences
Date Deposited:	08 Feb 2017 15:30
Last Modified:	12 Dec 2024 01:17
URI:	http://eprints.lse.ac.uk/id/eprint/69217

Actions (login required)

View Item