Quantifying the predictability of a predictand: demonstrating the diverse roles of serial dependence in the estimation of forecast skill

Jarman, Alexander and Smith, Leonard A. (2018) Quantifying the predictability of a predictand: demonstrating the diverse roles of serial dependence in the estimation of forecast skill. Quarterly Journal of the Royal Meteorological Society. ISSN 0035-9009

Text - Accepted Version Download (610kB)

• Author

Abstract

Predictability varies. In geophysical systems, and related mathematical dynamical systems, variations are often expressed as serial dependence in the skill with which the system is, or can be, predicted. It is well known, of course, that estimation is more complicated in cases where the time series sample in‐hand does not reflect an independent from the target population; failure to account for this results in erroneous estimates both of the skill of the forecast system and of the statistical uncertainty in the estimated skill. This effect need not be indicated in the time series of the predictand; specifically: it is proven by example that linear correlation in the predictand is neither necessary nor sufficient to identify misestimation. Wilks [Quarterly Journal of the Royal Meteorological Society 136, 2109 (2010)] has shown that temporal correlations in forecast skill give rise to biased estimates of skill of a forecast system, and made progress on accounting for this effect in probability‐of‐precipitation forecasts. Related effects are explored in probability density forecasts of a continuous target in three different dynamical systems (demonstrating that linear correlation in the predictand is neither necessary nor sufficient), and a simple procedure is presented as a straightforward, good practice test for the effect when estimating the skill of forecast system.

Item Type:	Article
Official URL:	https://rmets.onlinelibrary.wiley.com/journal/1477...
Additional Information:	© 2018 Royal Meteorological Society
Divisions:	Statistics Centre for Analysis of Time Series
Subjects:	H Social Sciences > HA Statistics
Date Deposited:	27 Jul 2018 09:08
Last Modified:	29 Feb 2024 21:30
URI:	http://eprints.lse.ac.uk/id/eprint/89492

Actions (login required)

View Item