Forecast evaluation tests and negative long-run variance estimates in small samples

David Harvey, Stephen Leybourne () and Emily Whitehouse

Discussion Papers from University of Nottingham, Granger Centre for Time Series Econometrics

Abstract: In this paper, we show that when computing standard Diebold-Mariano-type tests for equal forecast accuracy and forecast encompassing, the long-run variance can frequently be negative when dealing with multi-step-ahead predictions in small, but empirically relevant, sample sizes. We subsequently consider a number of alternative approaches to dealing with this problem, including direct inference in the problem cases and use of long-run variance estimators that guarantee positivity. The finite sample size and power of the different approaches are evaluated using extensive Monte Carlo simulation exercises. Overall, for multi-step-ahead forecasts, we find that the recently proposed Coroneo and Iacone (2016) test, which is based on a weighted periodogram long-run variance estimator, offers the best finite sample size and power performance.

Keywords: Forecast evaluation; Long-run variance estimation; Simulation; Diebold-Mariano test; Forecasting (search for similar items in EconPapers)
Date: 2017-03
New Economics Papers: this item is included in nep-ecm, nep-ets and nep-for
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (19)

Downloads: (external link)
https://www.nottingham.ac.uk/research/groups/grangercentre/documents/17-03.pdf (application/pdf)

Related works:
Journal Article: Forecast evaluation tests and negative long-run variance estimates in small samples (2017)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:not:notgts:17/03

Access Statistics for this paper

More papers in Discussion Papers from University of Nottingham, Granger Centre for Time Series Econometrics School of Economics University of Nottingham University Park Nottingham NG7 2RD. Contact information at EDIRC.
Bibliographic data for series maintained by ().