Hostname: page-component-586b7cd67f-r5fsc Total loading time: 0 Render date: 2024-11-22T06:01:36.852Z Has data issue: false hasContentIssue false

Evaluating Forecast Uncertainty

Published online by Cambridge University Press:  26 March 2020

Ray Barrell*
Affiliation:
National Institute of Economic and Social Research
Ehsan Khoman
Affiliation:
National Institute of Economic and Social Research
Simon Kirby
Affiliation:
National Institute of Economic and Social Research

Extract

The National Institute has been producing forecasts since 1958, and they are an essential part of our contribution to the policy debate in the UK and elsewhere. Model-based forecasts for the UK have been published every quarter1 since the 1970s, whilst model-based forecasts for the US and the major Europeans started only in the late 1980s. The country coverage of the European forecasts has increased over the years, and Euro Area forecasts began as soon as membership was clear. There is a long enough history of forecasting to be able to evaluate our performance, and this note extends the work reported in Pain, Riley and Weale (2001), Barrell, Kirby and Metz (2005) and Barrell and Metz (2006). The Institute forecasts for the UK are the main focus of the analysis in this note, but evaluations of the US and Euro Area forecasts produced by the Institute are also undertaken. We focus on evaluating the last forecast undertaken (at T–1) before the start of the year being forecast (at T), as they contain as much information as was possible without using any from the year being forecast. We also look at the evolution of forecasts over the two years preceding the publication of the first outturn for the year being forecast in order to gauge at which point those forecasts become efficient in that the root mean squared deviation (RMSD) of the errors is smaller than standard deviation of the series.

Type
Articles
Copyright
Copyright © 2007 National Institute of Economic and Social Research

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Barrell, R. (2003), ‘Monetary and fiscal frameworks in Europe - assessing and choosing monetary and fiscal policy rules’, Submissions on EMU from leading academics, HM Treasury EMU Assessment Exercise, June, pp. 314Google Scholar
Barrell, R., Kirby, S. and Metz, R. (2005), ‘Forecast comparisons’, National Institute Economic Review, 193, pp. 70–4.10.1177/0027950105058557CrossRefGoogle Scholar
Barrell, R. and Metz, R. (2006), ‘An assessment of NIESR forecast accuracy: US and Euro Area GDP and inflation’, National Institute Economic Review, April, pp. 36–9.CrossRefGoogle Scholar
Clements, M.P. and Hendry, D.H. (1998), Forecasting Economic Time Series, Cambridge, Cambridge University Press.CrossRefGoogle Scholar
Diebold, F.X. and Mariano, R.S. (1995), ‘Comparing predictive ccuracy’, Journal of Business and Economic Statistics 13 (3), pp. 253–63.Google Scholar
Harvey, D., Leybourne, S. and Newbold, P. (1997), ‘Testing the equality of prediction mean squared errors’, International Journal of Forecasting, 13 (2), pp. 281–91.CrossRefGoogle Scholar
Pain, N., Riley, R. and Weale, M. (2001), ‘The performance of Natinal Institutte economic forecasts’, National Institute Economic Review, 156, pp. 5562.Google Scholar