Forecasting with a real-time data set for macroeconomists

No 01-10, Working Papers from Federal Reserve Bank of Philadelphia

Abstract: This paper discusses how forecasts are affected by the use of real-time data rather than latest-available data. The key issue is this: In the literature on developing forecasting models, new models are put together based on the results they yield using the data set available to the model?s developer. But those are not the data that were available to a forecaster in real time. How much difference does the vintage of the data make for such forecasts? The authors explore this issue with a variety of exercises designed to answer this question. In particular, they find that the use of real-time data matters for some forecasting issues but not for others. It matters for choosing lag length in a univariate context. Preliminary evidence suggests that the span?or number?of forecast observations used to evaluate models may also be critical: the authors find that standard measures of forecast accuracy can be vintage-sensitive when constructed on the short spans (five years of quarterly data) of data sometimes used by researchers for forecast evaluation. The differences between using real-time and latest-available data may depend on what is being used as the ?actual? or realization, and we explore several alternatives that can be used. Perhaps of most importance, we show that measures of forecast error, such as root-mean-squared error and mean absolute error, can be deceptively lower when using latest-available data rather than real-time data. Thus, for purposes such as modeling expectations or evaluating forecast errors of survey data, the use of latest-available data is questionable; comparisons between the forecasts generated from new models and benchmark forecasts, generated in real time, should be based on real-time data.

Keywords: Forecasting (search for similar items in EconPapers)
Date: 2001
New Economics Papers: this item is included in nep-ets and nep-mac
References: Add references at CitEc
Citations: View citations in EconPapers (308)

Downloads: (external link)
https://www.philadelphiafed.org/-/media/frbp/asset ... ers/2001/wp01-10.pdf (application/pdf)

Related works:
Journal Article: Forecasting with a real-time data set for macroeconomists (2002)
Working Paper: Forecasting with a Real-Time Data Set for Macroeconomists (2001)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:fip:fedpwp:01-10

Ordering information: This working paper can be ordered from

Access Statistics for this paper

More papers in Working Papers from Federal Reserve Bank of Philadelphia Contact information at EDIRC.
Bibliographic data for series maintained by Beth Paul ().