Hostname: page-component-78c5997874-ndw9j Total loading time: 0 Render date: 2024-11-05T17:14:02.674Z Has data issue: false hasContentIssue false

Verification and value of the Australian Bureau of Meteorology township seasonal rainfall forecasts in Australia, 1997–2005

Published online by Cambridge University Press:  16 December 2005

A. L. Vizard
Affiliation:
School of Veterinary Science, University of Melbourne, 250 Princes Highway, Werribee, 3030 Australia
G. A. Anderson
Affiliation:
School of Veterinary Science, University of Melbourne, 250 Princes Highway, Werribee, 3030 Australia
D. J. Buckley
Affiliation:
School of Agricultural and Veterinary Sciences, Charles Sturt University, Locked Bag 588, Wagga Wagga, 2678 Australia Email: [email protected]
Get access

Abstract

We verified the Bureau of Meteorology's seasonal rainfall forecasts for 262 townships throughout Australia, from its inception in June 1997 to May 2005. The results indicate that the forecasting system had low skill. Brier Skill Score and the receiver operating characteristic values were uniformly close to the no skill value. Forecast variances were consistently small. The overall observed variance was 0.0048, 2.1% of the variance of a perfect system. The estimate of the gradient of the outcome against forecast was 0.42 and was imprecise. Definitive statements about bias cannot be made. The value of the forecasts for decision-makers was estimated using value score curves, calculated for six forecast scenarios. All curves indicated that no economic benefit could have been reliably derived by users of the seasonal rainfall forecasts, with the exception of users with decisions triggered by a small shift in the forecast from climatology, in which case small economic gains may have occurred. Small value scores were associated with the observed forecast variance, not the observed bias. We examined the expected change in value scores associated with any future increase in forecast variance. This showed that a moderate increase from the observed variance would bring limited benefits. Substantial value to a broad range of users will only occur with a large increase in forecast variance. To deliver this, new lead indicators with markedly better predictive characteristics may need to be developed for the seasonal rainfall forecasting system.

Type
Research Article
Copyright
2005 Royal Meteorological Society

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)