Nothing Special   »   [go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/a/wly/quante/v13y2022i1p95-123.html
   My bibliography  Save this article

Uncertain identification

Author

Listed:
  • Raffaella Giacomini
  • Toru Kitagawa
  • Alessio Volpicella
Abstract
Uncertainty about the choice of identifying assumptions is common in causal studies, but is often ignored in empirical practice. This paper considers uncertainty over models that impose different identifying assumptions, which can lead to a mix of point‐ and set‐identified models. We propose performing inference in the presence of such uncertainty by generalizing Bayesian model averaging. The method considers multiple posteriors for the set‐identified models and combines them with a single posterior for models that are either point‐identified or that impose nondogmatic assumptions. The output is a set of posteriors (post‐averaging ambiguous belief), which can be summarized by reporting the set of posterior means and the associated credible region. We clarify when the prior model probabilities are updated and characterize the asymptotic behavior of the posterior model probabilities. The method provides a formal framework for conducting sensitivity analysis of empirical findings to the choice of identifying assumptions. For example, we find that in a standard monetary model one would need to attach a prior probability greater than 0.28 to the validity of the assumption that prices do not react contemporaneously to a monetary policy shock, in order to obtain a negative response of output to the shock.

Suggested Citation

  • Raffaella Giacomini & Toru Kitagawa & Alessio Volpicella, 2022. "Uncertain identification," Quantitative Economics, Econometric Society, vol. 13(1), pages 95-123, January.
    • Handle: RePEc:wly:quante:v:13:y:2022:i:1:p:95-123
    DOI: 10.3982/QE1671
    as

    Download full text from publisher

    File URL: https://doi.org/10.3982/QE1671
    Download Restriction: no
    File URL: https://libkey.io/10.3982/QE1671?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Kitagawa, Toru & Muris, Chris, 2016. "Model averaging in semiparametric estimation of treatment effects," Journal of Econometrics, Elsevier, vol. 193(1), pages 271-289.
    2. Uhlig, Harald, 2005. "What are the effects of monetary policy on output? Results from an agnostic identification procedure," Journal of Monetary Economics, Elsevier, vol. 52(2), pages 381-419, March.
    3. Rafiq, M.S. & Mallick, S.K., 2008. "The effect of monetary policy on output in EMU3: A sign restriction approach," Journal of Macroeconomics, Elsevier, vol. 30(4), pages 1756-1791, December.
    4. Joseph G. Altonji & Todd E. Elder & Christopher R. Taber, 2005. "Selection on Observed and Unobserved Variables: Assessing the Effectiveness of Catholic Schools," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 151-184, February.
    5. S. Boragan Aruoba & Frank Schorfheide, 2011. "Sticky Prices versus Monetary Frictions: An Estimation of Policy Trade-Offs," American Economic Journal: Macroeconomics, American Economic Association, vol. 3(1), pages 60-90, January.
    6. Eleonora Granziera & Hyungsik Roger Moon & Frank Schorfheide, 2018. "Inference for VARs identified with sign restrictions," Quantitative Economics, Econometric Society, vol. 9(3), pages 1087-1121, November.
    7. Francesco Furlanetto & Francesco Ravazzolo & Samad Sarferaz, 2019. "Identification of Financial Factors in Economic Fluctuations," The Economic Journal, Royal Economic Society, vol. 129(617), pages 311-337.
    8. Federico Ciliberto & Elie Tamer, 2009. "Market Structure and Multiple Equilibria in Airline Markets," Econometrica, Econometric Society, vol. 77(6), pages 1791-1828, November.
    9. Vargas-Silva, Carlos, 2008. "Monetary policy and the US housing market: A VAR analysis imposing sign restrictions," Journal of Macroeconomics, Elsevier, vol. 30(3), pages 977-990, September.
    10. Andrew Mountford, 2005. "Leaning into the Wind: A Structural VAR Investigation of UK Monetary Policy," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(5), pages 597-621, October.
    11. Ashenfelter, Orley C, 1978. "Estimating the Effect of Training Programs on Earnings," The Review of Economics and Statistics, MIT Press, vol. 60(1), pages 47-57, February.
    12. Christiano, Lawrence J. & Eichenbaum, Martin & Evans, Charles L., 1999. "Monetary policy shocks: What have we learned and to what end?," Handbook of Macroeconomics, in: J. B. Taylor & M. Woodford (ed.), Handbook of Macroeconomics, edition 1, volume 1, chapter 2, pages 65-148, Elsevier.
    13. Nigar Hashimzade & Michael A. Thornton (ed.), 2013. "Handbook of Research Methods and Applications in Empirical Macroeconomics," Books, Edward Elgar Publishing, number 14327.
    14. Reichenstein, William, 1987. "The Impact of Money on Short-term Interest Rates," Economic Inquiry, Western Economic Association International, vol. 25(1), pages 67-82, January.
    15. Shigeru Fujita, 2011. "Dynamics of worker flows and vacancies: evidence from the sign restriction approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(1), pages 89-121, January/F.
    16. Andrew Mountford & Harald Uhlig, 2009. "What are the effects of fiscal policy shocks?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(6), pages 960-992.
    17. Antolín-Díaz, Juan & Petrella, Ivan & Rubio-Ramírez, Juan F., 2021. "Structural scenario analysis with SVARs," Journal of Monetary Economics, Elsevier, vol. 117(C), pages 798-815.
    18. Horowitz, Joel L & Manski, Charles F, 1995. "Identification and Robustness with Contaminated and Corrupted Data," Econometrica, Econometric Society, vol. 63(2), pages 281-302, March.
    19. Blanchard, Olivier Jean & Quah, Danny, 1993. "The Dynamic Effects of Aggregate Demand and Supply Disturbances: Reply," American Economic Review, American Economic Association, vol. 83(3), pages 653-658, June.
    20. Sims, Christopher A. & Waggoner, Daniel F. & Zha, Tao, 2008. "Methods for inference in large multiple-equation Markov-switching models," Journal of Econometrics, Elsevier, vol. 146(2), pages 255-274, October.
    21. Raffaella Giacomini & Toru Kitagawa, 2021. "Robust Bayesian Inference for Set‐Identified Models," Econometrica, Econometric Society, vol. 89(4), pages 1519-1556, July.
    22. Sims, Christopher A., 1992. "Interpreting the macroeconomic time series facts : The effects of monetary policy," European Economic Review, Elsevier, vol. 36(5), pages 975-1000, June.
    23. John Geweke, 1999. "Using simulation methods for bayesian econometric models: inference, development,and communication," Econometric Reviews, Taylor & Francis Journals, vol. 18(1), pages 1-73.
    24. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    25. Patrick Bajari & Han Hong & Stephen P. Ryan, 2010. "Identification and Estimation of a Discrete Game of Complete Information," Econometrica, Econometric Society, vol. 78(5), pages 1529-1568, September.
    26. Victor Chernozhukov & Han Hong & Elie Tamer, 2007. "Estimation and Confidence Regions for Parameter Sets in Econometric Models," Econometrica, Econometric Society, vol. 75(5), pages 1243-1284, September.
    27. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    28. Lutz Kilian & Daniel P. Murphy, 2012. "Why Agnostic Sign Restrictions Are Not Enough: Understanding The Dynamics Of Oil Market Var Models," Journal of the European Economic Association, European Economic Association, vol. 10(5), pages 1166-1188, October.
    29. Matthew A. Masten & Alexandre Poirier, 2020. "Inference on breakdown frontiers," Quantitative Economics, Econometric Society, vol. 11(1), pages 41-111, January.
    30. Dedola, Luca & Neri, Stefano, 2007. "What does a technology shock do? A VAR analysis with model-based sign restrictions," Journal of Monetary Economics, Elsevier, vol. 54(2), pages 512-549, March.
    31. Sungbae An & Frank Schorfheide, 2007. "Bayesian Analysis of DSGE Models," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 113-172.
    32. Lawrence J. Christiano & Martin Eichenbaum & Charles L. Evans, 2005. "Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 1-45, February.
    33. Gert Peersman & Roland Straub, 2009. "Technology Shocks And Robust Sign Restrictions In A Euro Area Svar," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 50(3), pages 727-750, August.
    34. Yuan Liao & Anna Simoni, 2012. "Semi-parametric Bayesian Partially Identified Models based on Support Function," Papers 1212.3267, arXiv.org, revised Nov 2013.
    35. Hjort N.L. & Claeskens G., 2003. "Frequentist Model Average Estimators," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 879-899, January.
    36. Canova, Fabio & Nicolo, Gianni De, 2002. "Monetary disturbances matter for business fluctuations in the G-7," Journal of Monetary Economics, Elsevier, vol. 49(6), pages 1131-1159, September.
    37. Bruce E. Hansen, 2014. "Model averaging, asymptotic risk, and regressor groups," Quantitative Economics, Econometric Society, vol. 5(3), pages 495-530, November.
    38. Christian Matthes & Felipe Schwartzman, 2019. "What Do Sectoral Dynamics Tell Us About the Origins of Business Cycles?," Working Paper 19-9, Federal Reserve Bank of Richmond.
    39. Chib S. & Jeliazkov I., 2001. "Marginal Likelihood From the Metropolis-Hastings Output," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 270-281, March.
    40. Marco Del Negro & Frank Schorfheide, 2004. "Priors from General Equilibrium Models for VARS," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 45(2), pages 643-673, May.
    41. Charles F. Manski & John V. Pepper, 2000. "Monotone Instrumental Variables, with an Application to the Returns to Schooling," Econometrica, Econometric Society, vol. 68(4), pages 997-1012, July.
    42. Liu, Chu-An, 2015. "Distribution theory of the least squares averaging estimator," Journal of Econometrics, Elsevier, vol. 186(1), pages 142-159.
    43. Toru Kitagawa, 2009. "Identification region of the potential outcome distributions under instrument independence," CeMMAP working papers CWP30/09, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    44. Dimitris Korobilis, 2020. "Sign restrictions in high-dimensional vector autoregressions," Working Papers 2020_21, Business School - Economics, University of Glasgow.
    45. Charles F. Manski, 1989. "Anatomy of the Selection Problem," Journal of Human Resources, University of Wisconsin Press, vol. 24(3), pages 343-360.
    46. Faust, Jon, 1998. "The robustness of identified VAR conclusions about money," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 49(1), pages 207-244, December.
    47. A. Norets & X. Tang, 2014. "Semiparametric Inference in Dynamic Binary Choice Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(3), pages 1229-1262.
    48. Ho, Paul, 2023. "Global robust Bayesian analysis in large models," Journal of Econometrics, Elsevier, vol. 235(2), pages 608-642.
    49. Magnus, Jan R. & Powell, Owen & Prüfer, Patricia, 2010. "A comparison of two model averaging techniques with an application to growth empirics," Journal of Econometrics, Elsevier, vol. 154(2), pages 139-153, February.
    50. Brendan Kline & Elie Tamer, 2016. "Bayesian inference in a class of partially identified models," Quantitative Economics, Econometric Society, vol. 7(2), pages 329-366, July.
    51. Arie Beresteanu & Ilya Molchanov & Francesca Molinari, 2011. "Sharp Identification Regions in Models With Convex Moment Predictions," Econometrica, Econometric Society, vol. 79(6), pages 1785-1821, November.
    52. Andriy Norets & Xun Tang, 2010. "Semiparametric Inference in Dynamic Binary Choice Models, Second Version," PIER Working Paper Archive 12-017, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 17 Apr 2012.
    53. Christiane Baumeister & James D. Hamilton, 2015. "Sign Restrictions, Structural Vector Autoregressions, and Useful Prior Information," Econometrica, Econometric Society, vol. 83(5), pages 1963-1999, September.
    54. John Geweke, 1999. "Using Simulation Methods for Bayesian Econometric Models," Computing in Economics and Finance 1999 832, Society for Computational Economics.
    55. Poirier, Dale J., 1998. "Revising Beliefs In Nonidentified Models," Econometric Theory, Cambridge University Press, vol. 14(4), pages 483-509, August.
    56. Claeskens,Gerda & Hjort,Nils Lid, 2008. "Model Selection and Model Averaging," Cambridge Books, Cambridge University Press, number 9780521852258, October.
    57. Hyungsik Roger Moon & Frank Schorfheide, 2012. "Bayesian and Frequentist Inference in Partially Identified Models," Econometrica, Econometric Society, vol. 80(2), pages 755-782, March.
    58. Hansen, Bruce E. & Racine, Jeffrey S., 2012. "Jackknife model averaging," Journal of Econometrics, Elsevier, vol. 167(1), pages 38-46.
    59. Pooyan Amir Ahmadi & Harald Uhlig, 2015. "Sign Restrictions in Bayesian FaVARs with an Application to Monetary Policy Shocks," NBER Working Papers 21738, National Bureau of Economic Research, Inc.
    60. Scholl, Almuth & Uhlig, Harald, 2008. "New evidence on the puzzles: Results from agnostic identification on monetary policy and exchange rates," Journal of International Economics, Elsevier, vol. 76(1), pages 1-13, September.
    61. Gafarov, Bulat & Meier, Matthias & Montiel Olea, José Luis, 2018. "Delta-method inference for a class of set-identified SVARs," Journal of Econometrics, Elsevier, vol. 203(2), pages 316-327.
    62. Toru Kitagawa, 2020. "The Identification Region of the Potential Outcome Distributions under Instrument Independence," CeMMAP working papers CWP23/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    63. Dedola, Luca & Neri, Stefano, 2007. "What does a technology shock do? A VAR analysis with model-based sign restrictions," Journal of Monetary Economics, Elsevier, vol. 54(2), pages 512-549, March.
    64. Frank Smets & Raf Wouters, 2003. "An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area," Journal of the European Economic Association, MIT Press, vol. 1(5), pages 1123-1175, September.
    65. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wu, Ping & Koop, Gary, 2023. "Estimating the ordering of variables in a VAR using a Plackett–Luce prior," Economics Letters, Elsevier, vol. 230(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alessio Volpicella, 2022. "SVARs Identification Through Bounds on the Forecast Error Variance," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(3), pages 1291-1301, June.
    2. Raffaella Giacomini & Toru Kitagawa, 2021. "Robust Bayesian Inference for Set‐Identified Models," Econometrica, Econometric Society, vol. 89(4), pages 1519-1556, July.
    3. Francesca Molinari, 2020. "Microeconometrics with Partial Identi?cation," CeMMAP working papers CWP15/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    4. Emanuele Bacchiocchi & Toru Kitagawa, 2020. "Locally- but not globally-identified SVARs," CeMMAP working papers CWP40/20, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    5. Victor Pontines, 2021. "The real effects of loan-to-value limits: empirical evidence from Korea," Empirical Economics, Springer, vol. 61(3), pages 1311-1350, September.
    6. Renée Fry & Adrian Pagan, 2011. "Sign Restrictions in Structural Vector Autoregressions: A Critical Review," Journal of Economic Literature, American Economic Association, vol. 49(4), pages 938-960, December.
    7. Lutz Kilian, 2013. "Structural vector autoregressions," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 22, pages 515-554, Edward Elgar Publishing.
    8. Eleonora Granziera & Hyungsik Roger Moon & Frank Schorfheide, 2018. "Inference for VARs identified with sign restrictions," Quantitative Economics, Econometric Society, vol. 9(3), pages 1087-1121, November.
    9. Baumeister, Christiane & Hamilton, James D., 2020. "Drawing conclusions from structural vector autoregressions identified on the basis of sign restrictions," Journal of International Money and Finance, Elsevier, vol. 109(C).
    10. Helmut Lütkepohl & Aleksei NetŠunajev, 2014. "Disentangling Demand And Supply Shocks In The Crude Oil Market: How To Check Sign Restrictions In Structural Vars," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(3), pages 479-496, April.
    11. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    12. Baumeister, Christiane & Hamilton, James D., 2021. "Reprint: Drawing conclusions from structural vector autoregressions identified on the basis of sign restrictions," Journal of International Money and Finance, Elsevier, vol. 114(C).
    13. Baumeister, Christiane & Hamilton, James D., 2018. "Inference in structural vector autoregressions when the identifying assumptions are not fully believed: Re-evaluating the role of monetary policy in economic fluctuations," Journal of Monetary Economics, Elsevier, vol. 100(C), pages 48-65.
    14. Inoue, Atsushi & Kilian, Lutz, 2013. "Inference on impulse response functions in structural VAR models," Journal of Econometrics, Elsevier, vol. 177(1), pages 1-13.
    15. Ramey, V.A., 2016. "Macroeconomic Shocks and Their Propagation," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 71-162, Elsevier.
    16. Giacomini, Raffaella & Kitagawa, Toru, 2014. "Inference about Non-Identified SVARs," CEPR Discussion Papers 10287, C.E.P.R. Discussion Papers.
    17. Herwartz, Helmut & Plödt, Martin, 2014. "Sign restrictions and statistical identification under volatility breaks -- Simulation based evidence and an empirical application to monetary policy analysis," VfS Annual Conference 2014 (Hamburg): Evidence-based Economic Policy 100326, Verein für Socialpolitik / German Economic Association.
    18. Ivan A. Canay & Azeem M. Shaikh, 2016. "Practical and theoretical advances in inference for partially identified models," CeMMAP working papers CWP05/16, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    19. Nadav Ben Zeev, 2019. "Is There A Single Shock That Drives The Majority Of Business Cycle Fluctuations?," Working Papers 1906, Ben-Gurion University of the Negev, Department of Economics.
    20. Giacomini, Raffaella & Kitagawa, Toru & Read, Matthew, 2022. "Robust Bayesian inference in proxy SVARs," Journal of Econometrics, Elsevier, vol. 228(1), pages 107-126.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:quante:v:13:y:2022:i:1:p:95-123. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/essssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.