Nothing Special   »   [go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/gwc/wpaper/2016-013.html
   My bibliography  Save this paper

What Do We Lose When We Average Expectations?

Author

Listed:
  • Constantin Burgi

    (The George Washington University)

Abstract
In this paper, I use the Bloomberg Survey of forecasts to assess if evaluating the distribution of expectations will lead to important additional insights over the evaluation of the simple average. I first introduce new approaches that allow me to assess the forecast accuracy and the information rigidity at the individual level despite a large share of missing data. Applying these new approaches, I find that taking into account the distribution can significantly improve the predictive power of the survey. For example, I find that the part of uncertainty measured by disagreement can improve the prediction of recessions in a dynamic probit model relative to the simple average. On information rigidity, I find that some of the rigidity found at the aggregate level likely stems from the aggregation process. Together, my findings suggest that we should look at individual expectations whenever possible as important insights are lost by just looking at aggregate expectations.

Suggested Citation

  • Constantin Burgi, 2016. "What Do We Lose When We Average Expectations?," Working Papers 2016-013, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting.
    • Handle: RePEc:gwc:wpaper:2016-013
    as

    Download full text from publisher

    File URL: https://www2.gwu.edu/~forcpgm/2016-013.pdf
    File Function: First version, 2016
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Giordani, Paolo & Soderlind, Paul, 2003. "Inflation forecast uncertainty," European Economic Review, Elsevier, vol. 47(6), pages 1037-1059, December.
    2. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    3. Dovern, Jonas & Weisser, Johannes, 2011. "Accuracy, unbiasedness and efficiency of professional macroeconomic forecasts: An empirical comparison for the G7," International Journal of Forecasting, Elsevier, vol. 27(2), pages 452-465.
    4. Messina, Jeffrey D. & Sinclair, Tara M. & Stekler, Herman, 2015. "What can we learn from revisions to the Greenbook forecasts?," Journal of Macroeconomics, Elsevier, vol. 45(C), pages 54-62.
    5. Holden, K & Peel, D A, 1990. "On Testing for Unbiasedness and Efficiency of Forecasts," The Manchester School of Economic & Social Studies, University of Manchester, vol. 58(2), pages 120-127, June.
    6. Jordà, Òscar & Knüppel, Malte & Marcellino, Massimiliano, 2013. "Empirical simultaneous prediction regions for path-forecasts," International Journal of Forecasting, Elsevier, vol. 29(3), pages 456-468.
    7. Mark R. Greer, 1999. "Assessing the Soothsayers: An Examination of the Track Record of Macroeconomic Forecasting," Journal of Economic Issues, Taylor & Francis Journals, vol. 33(1), pages 77-94, March.
    8. Andrade, Philippe & Le Bihan, Hervé, 2013. "Inattentive professional forecasters," Journal of Monetary Economics, Elsevier, vol. 60(8), pages 967-982.
    9. Clark, Todd E. & McCracken, Michael W., 2001. "Tests of equal forecast accuracy and encompassing for nested models," Journal of Econometrics, Elsevier, vol. 105(1), pages 85-110, November.
    10. Engelberg, Joseph & Manski, Charles F. & Williams, Jared, 2009. "Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 27, pages 30-41.
    11. N. Gregory Mankiw & Ricardo Reis, 2002. "Sticky Information versus Sticky Prices: A Proposal to Replace the New Keynesian Phillips Curve," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(4), pages 1295-1328.
    12. Carlos Capistr¡N & Allan Timmermann, 2009. "Disagreement and Biases in Inflation Expectations," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(2-3), pages 365-396, March.
    13. Alkire, Sabina & Foster, James, 2011. "Counting and multidimensional poverty measurement," Journal of Public Economics, Elsevier, vol. 95(7-8), pages 476-487, August.
    14. Harvey, David I & Leybourne, Stephen J & Newbold, Paul, 1998. "Tests for Forecast Encompassing," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(2), pages 254-259, April.
    15. Lucas, Robert Jr., 1972. "Expectations and the neutrality of money," Journal of Economic Theory, Elsevier, vol. 4(2), pages 103-124, April.
    16. Proaño, Christian R. & Theobald, Thomas, 2014. "Predicting recessions with a composite real-time dynamic probit model," International Journal of Forecasting, Elsevier, vol. 30(4), pages 898-917.
    17. Mitchell, Karlyn & Pearce, Douglas K., 2007. "Professional forecasts of interest rates and exchange rates: Evidence from the Wall Street Journal's panel of economists," Journal of Macroeconomics, Elsevier, vol. 29(4), pages 840-854, December.
    18. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
    19. Olivier Coibion & Yuriy Gorodnichenko, 2015. "Information Rigidity and the Expectations Formation Process: A Simple Framework and New Facts," American Economic Review, American Economic Association, vol. 105(8), pages 2644-2678, August.
    20. Tilman Ehrbeck & Robert Waldmann, 1996. "Why Are Professional Forecasters Biased? Agency versus Behavioral Explanations," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 111(1), pages 21-40.
    21. Fintzen, David & Stekler, H. O., 1999. "Why did forecasters fail to predict the 1990 recession?," International Journal of Forecasting, Elsevier, vol. 15(3), pages 309-323, July.
    22. Fildes, Robert & Stekler, Herman, 2002. "The state of macroeconomic forecasting," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 435-468, December.
    23. Batchelor, Roy, 2007. "Bias in macroeconomic forecasts," International Journal of Forecasting, Elsevier, vol. 23(2), pages 189-203.
    24. Nicholas Bloom, 2009. "The Impact of Uncertainty Shocks," Econometrica, Econometric Society, vol. 77(3), pages 623-685, May.
    25. Batchelor, Roy & Dua, Pami, 1993. "Survey vs ARCH Measures of Inflation Uncertainty," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 55(3), pages 341-353, August.
    26. Ozturk, Ezgi O. & Sheng, Xuguang Simon, 2018. "Measuring global and country-specific uncertainty," Journal of International Money and Finance, Elsevier, vol. 88(C), pages 276-295.
    27. Christopher D. Carroll, 2003. "Macroeconomic Expectations of Households and Professional Forecasters," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(1), pages 269-298.
    28. Graham Elliott & Ivana Komunjer & Allan Timmermann, 2008. "Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss?," Journal of the European Economic Association, MIT Press, vol. 6(1), pages 122-157, March.
    29. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    30. Kydland, Finn E & Prescott, Edward C, 1982. "Time to Build and Aggregate Fluctuations," Econometrica, Econometric Society, vol. 50(6), pages 1345-1370, November.
    31. Fildes, Robert & Stekler, Herman, 2002. "Reply to the comments on 'The state of macroeconomic forecasting'," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 503-505, December.
    32. Dovern, Jonas & Fritsche, Ulrich & Loungani, Prakash & Tamirisa, Natalia, 2015. "Information rigidities: Comparing average and individual forecasts for a large international panel," International Journal of Forecasting, Elsevier, vol. 31(1), pages 144-154.
    33. Yock Y. Chong & David F. Hendry, 1986. "Econometric Evaluation of Linear Macro-Economic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(4), pages 671-690.
    34. Capistrán, Carlos & Timmermann, Allan, 2009. "Forecast Combination With Entry and Exit of Experts," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 428-440.
    35. Lahiri, Kajal & Wang, J. George, 2013. "Evaluating probability forecasts for GDP declines using alternative methodologies," International Journal of Forecasting, Elsevier, vol. 29(1), pages 175-190.
    36. Ager, P. & Kappler, M. & Osterloh, S., 2009. "The accuracy and efficiency of the Consensus Forecasts: A further application and extension of the pooled approach," International Journal of Forecasting, Elsevier, vol. 25(1), pages 167-181.
    37. Lahiri, Kajal & Sheng, Xuguang, 2008. "Evolution of forecast disagreement in a Bayesian learning model," Journal of Econometrics, Elsevier, vol. 144(2), pages 325-340, June.
    38. Jordà, Òscar & Knüppel, Malte & Marcellino, Massimiliano, 2013. "Empirical simultaneous prediction regions for path-forecasts," International Journal of Forecasting, Elsevier, vol. 29(3), pages 456-468.
    39. Kajal Lahiri & Xuguang Sheng, 2010. "Measuring forecast uncertainty by disagreement: The missing link," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 514-538.
    40. Baghestani, Hamid, 2006. "An evaluation of the professional forecasts of U.S. long-term interest rates," Review of Financial Economics, Elsevier, vol. 15(2), pages 177-191.
    41. Lawrence J. Christiano & Roberto Motto & Massimo Rostagno, 2014. "Risk Shocks," American Economic Review, American Economic Association, vol. 104(1), pages 27-65, January.
    42. Kajal Lahiri & Huaming Peng & Yongchen Zhao, 2013. "Machine Learning and Forecast Combination in Incomplete Panels," Discussion Papers 13-01, University at Albany, SUNY, Department of Economics.
    43. Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
    44. Linda H. Chen & George J. Jiang & Qin Wang, 2013. "Market Reaction to Information Shocks—Does the Bloomberg and Briefing.com Survey Matter?," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 33(10), pages 939-964, October.
    45. Jacob A. Mincer, 1969. "Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance," NBER Books, National Bureau of Economic Research, Inc, number minc69-1.
    46. Davies, Anthony & Lahiri, Kajal, 1995. "A new framework for analyzing survey forecasts using three-dimensional panel data," Journal of Econometrics, Elsevier, vol. 68(1), pages 205-227, July.
    47. Lucas, Robert Jr, 1976. "Econometric policy evaluation: A critique," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 1(1), pages 19-46, January.
    48. Lahiri, Kajal & Teigland, Christie, 1987. "On the normality of probability distributions of inflation and GNP forecasts," International Journal of Forecasting, Elsevier, vol. 3(2), pages 269-279.
    49. Roy Batchelor, 2007. "Forecaster Behaviour and Bias in Macroeconomic Forecasts," ifo Working Paper Series 39, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    50. David Laster & Paul Bennett & In Sun Geoum, 1999. "Rational Bias in Macroeconomic Forecasts," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(1), pages 293-318.
    51. Chris Woolston, 2014. "Rice," Nature, Nature, vol. 514(7524), pages 49-49, October.
    52. Genre, Véronique & Kenny, Geoff & Meyler, Aidan & Timmermann, Allan, 2013. "Combining expert forecasts: Can anything beat the simple average?," International Journal of Forecasting, Elsevier, vol. 29(1), pages 108-121.
    53. Dovern, Jonas & Jannsen, Nils, 2017. "Systematic errors in growth expectations over the business cycle," International Journal of Forecasting, Elsevier, vol. 33(4), pages 760-769.
    54. Nordhaus, William D, 1987. "Forecasting Efficiency: Concepts and Applications," The Review of Economics and Statistics, MIT Press, vol. 69(4), pages 667-674, November.
    55. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    56. Rubaszek, Michal & Skrzypczynski, Pawel, 2008. "On the forecasting performance of a small-scale DSGE model," International Journal of Forecasting, Elsevier, vol. 24(3), pages 498-512.
    57. Zarnowitz, Victor & Lambros, Louis A, 1987. "Consensus and Uncertainty in Economic Prediction," Journal of Political Economy, University of Chicago Press, vol. 95(3), pages 591-621, June.
    58. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    59. Batchelor, R A, 1990. "All Forecasters Are Equal," Journal of Business & Economic Statistics, American Statistical Association, vol. 8(1), pages 143-144, January.
    60. Victor Zarnowitz, 1986. "The Record and Improvability of Economic Forecasting," NBER Working Papers 2099, National Bureau of Economic Research, Inc.
    61. Driver, Ciaran & Trapani, Lorenzo & Urga, Giovanni, 2013. "On the use of cross-sectional measures of forecast uncertainty," International Journal of Forecasting, Elsevier, vol. 29(3), pages 367-377.
    62. Bomberger, William A, 1996. "Disagreement as a Measure of Uncertainty," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 28(3), pages 381-392, August.
    63. Ashiya, Masahiro, 2006. "Forecast accuracy and product differentiation of Japanese Institutional Forecasters," International Journal of Forecasting, Elsevier, vol. 22(2), pages 395-401.
    64. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Constantin Bürgi, 2020. "Expectation Formation and the Persistence of Shocks," Working Papers 2020-005, The George Washington University, Department of Economics, H. O. Stekler Research Program on Forecasting, revised Sep 2020.
    2. Constantin Bürgi & Tara M. Sinclair, 2021. "What does forecaster disagreement tell us about the state of the economy?," Applied Economics Letters, Taylor & Francis Journals, vol. 28(1), pages 49-53, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    2. Conrad, Christian & Lahiri, Kajal, 2023. "Heterogeneous expectations among professional forecasters," ZEW Discussion Papers 23-062, ZEW - Leibniz Centre for European Economic Research.
    3. Dovern, Jonas & Jannsen, Nils, 2017. "Systematic errors in growth expectations over the business cycle," International Journal of Forecasting, Elsevier, vol. 33(4), pages 760-769.
    4. Sergey V. Smirnov & Daria A. Avdeeva, 2016. "Wishful Bias in Predicting Us Recessions: Indirect Evidence," HSE Working papers WP BRP 135/EC/2016, National Research University Higher School of Economics.
    5. Clements, Michael P., 2006. "Internal consistency of survey respondentsíforecasts: Evidence based on the Survey of Professional Forecasters," Economic Research Papers 269742, University of Warwick - Department of Economics.
    6. Papastamos, Dimitrios & Matysiak, George & Stevenson, Simon, 2015. "Assessing the accuracy and dispersion of real estate investment forecasts," International Review of Financial Analysis, Elsevier, vol. 42(C), pages 141-152.
    7. Clements, Michael P., 2021. "Do survey joiners and leavers differ from regular participants? The US SPF GDP growth and inflation forecasts," International Journal of Forecasting, Elsevier, vol. 37(2), pages 634-646.
    8. Kajal Lahiri & Huaming Peng & Xuguang Simon Sheng, 2022. "Measuring Uncertainty of a Combined Forecast and Some Tests for Forecaster Heterogeneity," Advances in Econometrics, in: Essays in Honor of M. Hashem Pesaran: Prediction and Macro Modeling, volume 43, pages 29-50, Emerald Group Publishing Limited.
    9. Pedersen, Michael, 2015. "What affects the predictions of private forecasters? The role of central bank forecasts in Chile," International Journal of Forecasting, Elsevier, vol. 31(4), pages 1043-1055.
    10. Clements, Michael P., 2010. "Explanations of the inconsistencies in survey respondents' forecasts," European Economic Review, Elsevier, vol. 54(4), pages 536-549, May.
    11. Bürgi, Constantin, 2017. "Bias, rationality and asymmetric loss functions," Economics Letters, Elsevier, vol. 154(C), pages 113-116.
    12. Michael P. Clements, 2014. "US Inflation Expectations and Heterogeneous Loss Functions, 1968–2010," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(1), pages 1-14, January.
    13. repec:lan:wpaper:470 is not listed on IDEAS
    14. Deschamps, Bruno & Ioannidis, Christos & Ka, Kook, 2020. "High-frequency credit spread information and macroeconomic forecast revision," International Journal of Forecasting, Elsevier, vol. 36(2), pages 358-372.
    15. Michael P. Clements, 2022. "Forecaster Efficiency, Accuracy, and Disagreement: Evidence Using Individual‐Level Survey Data," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 54(2-3), pages 537-568, March.
    16. Loungani, Prakash & Stekler, Herman & Tamirisa, Natalia, 2013. "Information rigidity in growth forecasts: Some cross-country evidence," International Journal of Forecasting, Elsevier, vol. 29(4), pages 605-621.
    17. Messina, Jeffrey D. & Sinclair, Tara M. & Stekler, Herman, 2015. "What can we learn from revisions to the Greenbook forecasts?," Journal of Macroeconomics, Elsevier, vol. 45(C), pages 54-62.
    18. repec:lan:wpaper:425 is not listed on IDEAS
    19. repec:lan:wpaper:539557 is not listed on IDEAS
    20. repec:lan:wpaper:413 is not listed on IDEAS
    21. Fildes, Robert & Stekler, Herman, 2002. "The state of macroeconomic forecasting," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 435-468, December.
    22. Karsten Müller, 2022. "German forecasters’ narratives: How informative are German business cycle forecast reports?," Empirical Economics, Springer, vol. 62(5), pages 2373-2415, May.
    23. Ericsson, Neil R., 2016. "Eliciting GDP forecasts from the FOMC’s minutes around the financial crisis," International Journal of Forecasting, Elsevier, vol. 32(2), pages 571-583.
    24. Döpke, Jörg & Fritsche, Ulrich & Müller, Karsten, 2019. "Has macroeconomic forecasting changed after the Great Recession? Panel-based evidence on forecast accuracy and forecaster behavior from Germany," Journal of Macroeconomics, Elsevier, vol. 62(C).

    More about this item

    Keywords

    Expectations; Bloomberg Survey; Forecast Evaluation; Uncertainty; Dynamic Probit;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E17 - Macroeconomics and Monetary Economics - - General Aggregative Models - - - Forecasting and Simulation: Models and Applications
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gwc:wpaper:2016-013. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: GW Economics Department (email available below). General contact details of provider: https://edirc.repec.org/data/pfgwuus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.