Nothing Special   »   [go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/fip/fednsr/830.html
   My bibliography  Save this paper

Macroeconomic nowcasting and forecasting with big data

Author

Abstract
Data, data, data . . . Economists know it well, especially when it comes to monitoring macroeconomic conditions the basis for making informed economic and policy decisions. Handling large and complex data sets was a challenge that macroeconomists engaged in real-time analysis faced long before big data? became pervasive in other disciplines. We review how methods for tracking economic conditions using big data have evolved over time and explain how econometric techniques have advanced to mimic and automate the best practices of forecasters on trading desks, at central banks, and in other market-monitoring roles. We present in detail the methodology underlying the New York Fed Staff Nowcast, which employs these innovative techniques to produce early estimates of GDP growth, synthesizing a wide range of macroeconomic data as they become available.

Suggested Citation

  • Brandyn Bok & Daniele Caratelli & Domenico Giannone & Argia M. Sbordone & Andrea Tambalotti, 2017. "Macroeconomic nowcasting and forecasting with big data," Staff Reports 830, Federal Reserve Bank of New York.
    • Handle: RePEc:fip:fednsr:830
    as

    Download full text from publisher

    File URL: https://www.newyorkfed.org/research/staff_reports/sr830.html
    File Function: Summary
    Download Restriction: no
    File URL: https://www.newyorkfed.org/medialibrary/media/research/staff_reports/sr830.pdf
    File Function: Full text
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Altavilla, Carlo & Giannone, Domenico & Modugno, Michele, 2017. "Low frequency effects of macroeconomic news on government bond yields," Journal of Monetary Economics, Elsevier, vol. 92(C), pages 31-46.
    2. Giannone, Domenico & Reichlin, Lucrezia & Small, David, 2008. "Nowcasting: The real-time informational content of macroeconomic data," Journal of Monetary Economics, Elsevier, vol. 55(4), pages 665-676, May.
    3. Doz, Catherine & Giannone, Domenico & Reichlin, Lucrezia, 2011. "A two-step estimator for large approximate dynamic factor models based on Kalman filtering," Journal of Econometrics, Elsevier, vol. 164(1), pages 188-205, September.
    4. Knotek, Edward S. & Zaman, Saeed, 2019. "Financial nowcasts and their usefulness in macroeconomic forecasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1708-1724.
    5. Lahiri, Kajal & Monokroussos, George, 2013. "Nowcasting US GDP: The role of ISM business surveys," International Journal of Forecasting, Elsevier, vol. 29(4), pages 644-658.
    6. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2015. "Bayesian VARs: Specification Choices and Forecast Accuracy," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(1), pages 46-73, January.
    7. Antonello D’Agostino & Domenico Giannone & Michele Lenza & Michele Modugno, 2016. "Nowcasting Business Cycles: A Bayesian Approach to Dynamic Heterogeneous Factor Models," Advances in Econometrics, in: Dynamic Factor Models, volume 35, pages 569-594, Emerald Group Publishing Limited.
    8. Alain Kabundi & Elmarie Nel & Franz Ruch, 2016. "Nowcasting Real GDP growth in South Africa," Working Papers 581, Economic Research Southern Africa.
    9. Matheson, Troy D., 2010. "An analysis of the informational content of New Zealand data releases: The importance of business opinion surveys," Economic Modelling, Elsevier, vol. 27(1), pages 304-314, January.
    10. Dahlhaus, Tatjana & Guénette, Justin-Damien & Vasishtha, Garima, 2017. "Nowcasting BRIC+M in real time," International Journal of Forecasting, Elsevier, vol. 33(4), pages 915-935.
    11. Elena Angelini & Gonzalo Camba‐Mendez & Domenico Giannone & Lucrezia Reichlin & Gerhard Rünstler, 2011. "Short‐term forecasts of euro area GDP growth," Econometrics Journal, Royal Economic Society, vol. 14(1), pages 25-44, February.
    12. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    13. Reichlin, Lucrezia & Giannone, Domenico & Small, David, 2005. "Nowcasting GDP and Inflation: The Real Time Informational Content of Macroeconomic Data Releases," CEPR Discussion Papers 5178, C.E.P.R. Discussion Papers.
    14. Refet S. Gürkaynak & Jonathan H. Wright, 2013. "Identification and Inference Using Event Studies," Manchester School, University of Manchester, vol. 81, pages 48-65, September.
    15. repec:ulb:ulbeco:2013/13388 is not listed on IDEAS
    16. Alberto Caruso, 2015. "Nowcasting Mexican GDP," Working Papers ECARES ECARES 2015-40, ULB -- Universite Libre de Bruxelles.
    17. Aruoba, S. BoraÄŸan & Diebold, Francis X. & Scotti, Chiara, 2009. "Real-Time Measurement of Business Conditions," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 417-427.
    18. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    19. White, Halbert, 1982. "Maximum Likelihood Estimation of Misspecified Models," Econometrica, Econometric Society, vol. 50(1), pages 1-25, January.
    20. Don Harding & Adrian Pagan, 2016. "The Econometric Analysis of Recurrent Events in Macroeconomics and Finance," Economics Books, Princeton University Press, edition 1, number 10744.
    21. Juan Antolin-Diaz & Thomas Drechsel & Ivan Petrella, 2017. "Tracking the Slowdown in Long-Run GDP Growth," The Review of Economics and Statistics, MIT Press, vol. 99(2), pages 343-356, May.
    22. Scott Brave & R. Andrew Butters & Alejandro Justiniano, 2016. "Forecasting Economic Activity with Mixed Frequency Bayesian VARs," Working Paper Series WP-2016-5, Federal Reserve Bank of Chicago.
    23. Gary Koop, 2017. "Bayesian Methods for Empirical Macroeconomics," Review of Economic Analysis, Digital Initiatives at the University of Waterloo Library, vol. 9(1), pages 33-56, June.
    24. Harding, Don & Pagan, Adrian, 2002. "Dissecting the cycle: a methodological investigation," Journal of Monetary Economics, Elsevier, vol. 49(2), pages 365-381, March.
    25. Tony Chernis & Rodrigo Sekkel, 2017. "A dynamic factor model for nowcasting Canadian GDP growth," Empirical Economics, Springer, vol. 53(1), pages 217-234, August.
    26. Patrick C. Higgins, 2014. "GDPNow: A Model for GDP \"Nowcasting\"," FRB Atlanta Working Paper 2014-7, Federal Reserve Bank of Atlanta.
    27. De Mol, Christine & Giannone, Domenico & Reichlin, Lucrezia, 2008. "Forecasting using a large number of predictors: Is Bayesian shrinkage a valid alternative to principal components?," Journal of Econometrics, Elsevier, vol. 146(2), pages 318-328, October.
    28. Tobias Adrian & Nina Boyarchenko & Domenico Giannone, 2019. "Vulnerable Growth," American Economic Review, American Economic Association, vol. 109(4), pages 1263-1289, April.
    29. Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2000. "The Generalized Dynamic-Factor Model: Identification And Estimation," The Review of Economics and Statistics, MIT Press, vol. 82(4), pages 540-554, November.
    30. J. Steven Landefeld & Eugene P. Seskin & Barbara M. Fraumeni, 2008. "Taking the Pulse of the Economy: Measuring GDP," Journal of Economic Perspectives, American Economic Association, vol. 22(2), pages 193-216, Spring.
    31. Frank Schorfheide & Dongho Song, 2015. "Real-Time Forecasting With a Mixed-Frequency VAR," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(3), pages 366-380, July.
    32. Marta Bańbura & Michele Modugno, 2014. "Maximum Likelihood Estimation Of Factor Models On Datasets With Arbitrary Pattern Of Missing Data," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(1), pages 133-160, January.
    33. Tim Mahedy & Glenn D. Rudebusch & Daniel J. Wilson, 2015. "The puzzle of weak first-quarter GDP growth," FRBSF Economic Letter, Federal Reserve Bank of San Francisco.
    34. Matteo Luciani & Lorenzo Ricci, 2014. "Nowcasting Norway," International Journal of Central Banking, International Journal of Central Banking, vol. 10(4), pages 215-248, December.
    35. James H. Stock & Mark W. Watson, 1989. "New Indexes of Coincident and Leading Economic Indicators," NBER Chapters, in: NBER Macroeconomics Annual 1989, Volume 4, pages 351-409, National Bureau of Economic Research, Inc.
    36. Keith R. Phillips & Jack Wang, 2016. "Residual seasonality in U.S. GDP data," Working Papers 1608, Federal Reserve Bank of Dallas.
    37. Roberto S. Mariano & Yasutomo Murasawa, 2003. "A new coincident index of business cycles based on monthly and quarterly series," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(4), pages 427-443.
    38. G. Rünstler & K. Barhoumi & S. Benk & R. Cristadoro & A. Den Reijer & A. Jakaitiene & P. Jelonek & A. Rua & K. Ruth & C. Van Nieuwenhuyze, 2009. "Short-term forecasting of GDP using large datasets: a pseudo real-time forecast evaluation exercise," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 28(7), pages 595-611.
    39. Bragoli, Daniela, 2017. "Now-casting the Japanese economy," International Journal of Forecasting, Elsevier, vol. 33(2), pages 390-402.
    40. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    41. repec:hal:journl:peer-00844811 is not listed on IDEAS
    42. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    43. Joelle Liebermann, 2014. "Real-Time Nowcasting of GDP: A Factor Model vs. Professional Forecasters," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 76(6), pages 783-811, December.
    44. Charles E. Gilbert & Norman J. Morin & Andrew D. Paciorek & Claudia R. Sahm, 2015. "Residual Seasonality in GDP," FEDS Notes 2015-05-14, Board of Governors of the Federal Reserve System (U.S.).
    45. Arthur F. Burns & Wesley C. Mitchell, 1946. "Measuring Business Cycles," NBER Books, National Bureau of Economic Research, Inc, number burn46-1.
    46. Gerhard Bry & Charlotte Boschan, 1971. "Foreword to "Cyclical Analysis of Time Series: Selected Procedures and Computer Programs"," NBER Chapters, in: Cyclical Analysis of Time Series: Selected Procedures and Computer Programs, pages -1, National Bureau of Economic Research, Inc.
    47. Knut Aastveit & Tørres Trovik, 2012. "Nowcasting norwegian GDP: the role of asset prices in a small open economy," Empirical Economics, Springer, vol. 42(1), pages 95-119, February.
    48. Leonardo Bartolini & Linda S. Goldberg & Adam Sacarny, 2008. "How economic news moves markets," Current Issues in Economics and Finance, Federal Reserve Bank of New York, vol. 14(Aug).
    49. Kurt Graden Lunsford, 2017. "Lingering Residual Seasonality in GDP Growth," Economic Commentary, Federal Reserve Bank of Cleveland, issue March.
    50. Thomas J. Sargent & Christopher A. Sims, 1977. "Business cycle modeling without pretending to have too much a priori economic theory," Working Papers 55, Federal Reserve Bank of Minneapolis.
    51. Gerhard Bry & Charlotte Boschan, 1971. "Cyclical Analysis of Time Series: Selected Procedures and Computer Programs," NBER Books, National Bureau of Economic Research, Inc, number bry_71-1.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bańbura, Marta & Giannone, Domenico & Modugno, Michele & Reichlin, Lucrezia, 2013. "Now-Casting and the Real-Time Data Flow," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 195-237, Elsevier.
    2. Cimadomo, Jacopo & Giannone, Domenico & Lenza, Michele & Monti, Francesca & Sokol, Andrej, 2022. "Nowcasting with large Bayesian vector autoregressions," Journal of Econometrics, Elsevier, vol. 231(2), pages 500-519.
    3. Cascaldi-Garcia, Danilo & Ferreira, Thiago R.T. & Giannone, Domenico & Modugno, Michele, 2024. "Back to the present: Learning about the euro area through a now-casting model," International Journal of Forecasting, Elsevier, vol. 40(2), pages 661-686.
    4. Caruso, Alberto, 2018. "Nowcasting with the help of foreign indicators: The case of Mexico," Economic Modelling, Elsevier, vol. 69(C), pages 160-168.
    5. Rusnák, Marek, 2016. "Nowcasting Czech GDP in real time," Economic Modelling, Elsevier, vol. 54(C), pages 26-39.
    6. Danilo Cascaldi-Garcia & Matteo Luciani & Michele Modugno, 2023. "Lessons from Nowcasting GDP across the World," International Finance Discussion Papers 1385, Board of Governors of the Federal Reserve System (U.S.).
    7. Bragoli, Daniela & Modugno, Michele, 2017. "A now-casting model for Canada: Do U.S. variables matter?," International Journal of Forecasting, Elsevier, vol. 33(4), pages 786-800.
    8. Dahlhaus, Tatjana & Guénette, Justin-Damien & Vasishtha, Garima, 2017. "Nowcasting BRIC+M in real time," International Journal of Forecasting, Elsevier, vol. 33(4), pages 915-935.
    9. Matteo Luciani & Lorenzo Ricci, 2014. "Nowcasting Norway," International Journal of Central Banking, International Journal of Central Banking, vol. 10(4), pages 215-248, December.
    10. Martha Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Nowcasting," Working Papers ECARES ECARES 2010-021, ULB -- Universite Libre de Bruxelles.
    11. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    12. Poncela, Pilar & Ruiz, Esther & Miranda, Karen, 2021. "Factor extraction using Kalman filter and smoothing: This is not just another survey," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1399-1425.
    13. Caruso, Alberto, 2019. "Macroeconomic news and market reaction: Surprise indexes meet nowcasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1725-1734.
    14. Bragoli, Daniela, 2017. "Now-casting the Japanese economy," International Journal of Forecasting, Elsevier, vol. 33(2), pages 390-402.
    15. Tóth, Peter, 2014. "Malý dynamický faktorový model na krátkodobé prognózovanie slovenského HDP [A Small Dynamic Factor Model for the Short-Term Forecasting of Slovak GDP]," MPRA Paper 63713, University Library of Munich, Germany.
    16. Kaufmann, Daniel & Scheufele, Rolf, 2017. "Business tendency surveys and macroeconomic fluctuations," International Journal of Forecasting, Elsevier, vol. 33(4), pages 878-893.
    17. Antonello D’Agostino & Domenico Giannone & Michele Lenza & Michele Modugno, 2016. "Nowcasting Business Cycles: A Bayesian Approach to Dynamic Heterogeneous Factor Models," Advances in Econometrics, in: Dynamic Factor Models, volume 35, pages 569-594, Emerald Group Publishing Limited.
    18. Chauvet, Marcelle & Potter, Simon, 2013. "Forecasting Output," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 141-194, Elsevier.
    19. Matteo Luciani & Madhavi Pundit & Arief Ramayandi & Giovanni Veronese, 2018. "Nowcasting Indonesia," Empirical Economics, Springer, vol. 55(2), pages 597-619, September.
    20. Chernis, Tony & Cheung, Calista & Velasco, Gabriella, 2020. "A three-frequency dynamic factor model for nowcasting Canadian provincial GDP growth," International Journal of Forecasting, Elsevier, vol. 36(3), pages 851-872.

    More about this item

    Keywords

    monitoring economic conditions; business cycles; macroeconomic data; large datasets; high-dimensional data; real-time data flow; factor models; state-space models; Kalman filter;
    All these keywords.

    JEL classification:

    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis
    • E32 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Business Fluctuations; Cycles

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fednsr:830. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Gabriella Bucciarelli (email available below). General contact details of provider: https://edirc.repec.org/data/frbnyus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.