Nothing Special   »   [go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/cir/cirwor/2001s-40.html
   My bibliography  Save this paper

Logiques et tests d'hypothèses : réflexions sur les problèmes mal posés en économétrie

Author

Listed:
  • Jean-Marie Dufour
Abstract
In this text, we review recent developments in econometrics from the viewpoint of statistical test theory. We first review some basic principles of philosophy of science and statistical theory, emphasizing parsimony and falsifiability as criteria for evaluating models, test theory as a formalization of the falsification principle for probabilistic models, and the logical foundation of basic notions in test theory (such as the level of a test). We then show that some of the most frequently used statistical and econometric methods are fundamentally inappropriate for the problems and models considered, while several hypotheses, for which test procedures are commonly proposed, are not testable at all. Such situations lead to ill-defined statistical problems. We analyze several cases of such problems: (1) building confidence intervals in structural models where identification problems may be present; (2) the construction of tests for nonparametric hypotheses, including procedures robust to heteroskedasticity, non-normality or dynamic specification. We point out that these difficulties often originate from the ambition to weaken regularity conditions typically required by statistical analysis, and from an inappropriate use of asymptotic distributional theory. Finally, we underscore the importance of formulating testable hypotheses and models, and of developing econometric methods with provable finite-sample properties. Dans ce texte, nous analysons les développements récents de l'économétrie à la lumière de la théorie des tests statistiques. Nous revoyons d'abord quelques principes fondamentaux de philosophie des sciences et de théorie statistique, en mettant l'accent sur la parcimonie et la falsifiabilité comme critères d'évaluation des modèles, sur le rôle de la théorie des tests comme formalisation du principe de falsification de modèles probabilistes, ainsi que sur la justification logique des notions de base de la théorie des tests (telles que le niveau d'un test). Nous montrons ensuite que certaines des méthodes statistiques et économétriques les plus utilisées sont fondamentalement inappropriées pour les problèmes et modèles considérés, tandis que de nombreuses hypothèses, pour lesquelles des procédures de test sont communément proposées, ne sont en fait pas du tout testables. De telles situations conduisent à des problèmes statistiques mal posés. Nous analysons quelques cas particuliers de tels problèmes: (1) la construction d'intervalles de confiance dans le cadre de modèles structurels qui posent des problèmes d'identification; (2) la construction de tests pour des hypothèses non paramétriques, incluant la construction de procédures robustes à l'hétéroscédasticité, à la non-normalité ou à la spécification dynamique. Nous indiquons que ces difficultés proviennent souvent de l'ambition d'affaiblir les conditions de régularité nécessaires à toute analyse statistique ainsi que d'une utilisation inappropriée de résultats de théorie distributionnelle asymptotique. Enfin, nous soulignons l'importance de formuler des hypothèses et modèles testables, et de proposer des techniques économétriques dont les propriétés sont démontrables dans les échantillons finis.

Suggested Citation

  • Jean-Marie Dufour, 2001. "Logiques et tests d'hypothèses : réflexions sur les problèmes mal posés en économétrie," CIRANO Working Papers 2001s-40, CIRANO.
    • Handle: RePEc:cir:cirwor:2001s-40
    as

    Download full text from publisher

    File URL: https://cirano.qc.ca/files/publications/2001s-40.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Phillips, Peter C B, 1985. "The Exact Distribution of LIML: II," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 26(1), pages 21-36, February.
    2. McManus, Douglas A. & Nankervis, John C. & Savin, N. E., 1994. "Multiple optima and asymptotic approximations in the partial adjustment model," Journal of Econometrics, Elsevier, vol. 62(2), pages 91-128, June.
    3. Faust, Jon, 1996. "Near Observational Equivalence and Theoretical size Problems with Unit Root Tests," Econometric Theory, Cambridge University Press, vol. 12(4), pages 724-731, October.
    4. Jon Faust, 1996. "Theoretical confidence level problems with confidence intervals for the spectrum of a time series," International Finance Discussion Papers 575, Board of Governors of the Federal Reserve System (U.S.).
    5. John Bound & David A. Jaeger & Regina Baker, 1993. "The Cure Can Be Worse than the Disease: A Cautionary Tale Regarding Instrumental Variables," NBER Technical Working Papers 0137, National Bureau of Economic Research, Inc.
    6. Nelson, Charles R & Startz, Richard, 1990. "Some Further Results on the Exact Small Sample Properties of the Instrumental Variable Estimator," Econometrica, Econometric Society, vol. 58(4), pages 967-976, July.
    7. Zivot, Eric & Startz, Richard & Nelson, Charles R, 1998. "Valid Confidence Intervals and Inference in the Presence of Weak Instruments," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 1119-1146, November.
    8. White,Halbert, 1996. "Estimation, Inference and Specification Analysis," Cambridge Books, Cambridge University Press, number 9780521574464, October.
    9. Richard Startz & Charles Nelson & Eric Zivot, 1999. "Improved Inference for the Instrumental Variable Estimator," Working Papers 0039, University of Washington, Department of Economics.
    10. Dufour, Jean-Marie & Jasiak, Joann, 2001. "Finite Sample Limited Information Inference Methods for Structural Equations and Models with Generated Regressors," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 42(3), pages 815-843, August.
    11. Jean‐Marie Dufour, 1981. "Rank Tests For Serial Dependence," Journal of Time Series Analysis, Wiley Blackwell, vol. 2(3), pages 117-128, May.
    12. Nelson, Charles R & Startz, Richard, 1990. "The Distribution of the Instrumental Variables Estimator and Its t-Ratio When the Instrument Is a Poor One," The Journal of Business, University of Chicago Press, vol. 63(1), pages 125-140, January.
    13. Phillips, P C B, 1987. "Time Series Regression with a Unit Root," Econometrica, Econometric Society, vol. 55(2), pages 277-301, March.
    14. Sargan, J D, 1983. "Identification and Lack of Identification," Econometrica, Econometric Society, vol. 51(6), pages 1605-1633, November.
    15. Blough, Stephen R, 1992. "The Relationship between Power and Level for Generic Unit Root Tests in Finite Samples," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 7(3), pages 295-308, July-Sept.
    16. DUFOUR, Jean-Marie & JASIAK, Joanna, 1998. "Finite-Sample Inference Methods for Simultaneous Equations and Models with Unobserved and Generated Regressors," Cahiers de recherche 9812, Universite de Montreal, Departement de sciences economiques.
    17. Buse, A, 1992. "The Bias of Instrumental Variable Estimators," Econometrica, Econometric Society, vol. 60(1), pages 173-180, January.
    18. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    19. Davidson, Russell & MacKinnon, James G., 1993. "Estimation and Inference in Econometrics," OUP Catalogue, Oxford University Press, number 9780195060119.
    20. Jiahui Wang & Eric Zivot, 1998. "Inference on Structural Parameters in Instrumental Variables Regression with Weak Instruments," Econometrica, Econometric Society, vol. 66(6), pages 1389-1404, November.
    21. Campbell, Bryan & Dufour, Jean-Marie, 1997. "Exact Nonparametric Tests of Orthogonality and Random Walk in the Presence of a Drift Parameter," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 38(1), pages 151-173, February.
    22. Touhami Abdelkhalek & Jean-Marie Dufour, 1998. "Statistical Inference For Computable General Equilibrium Models, With Application To A Model Of The Moroccan Economy," The Review of Economics and Statistics, MIT Press, vol. 80(4), pages 520-534, November.
    23. Gourieroux,Christian & Monfort,Alain, 1995. "Statistics and Econometric Models," Cambridge Books, Cambridge University Press, number 9780521477444, October.
    24. Hall, Alastair R & Rudebusch, Glenn D & Wilcox, David W, 1996. "Judging Instrument Relevance in Instrumental Variables Estimation," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 37(2), pages 283-298, May.
    25. Phillips, P.C.B., 1989. "Partially Identified Econometric Models," Econometric Theory, Cambridge University Press, vol. 5(2), pages 181-240, August.
    26. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    27. Douglas Staiger & James H. Stock, 1997. "Instrumental Variables Regression with Weak Instruments," Econometrica, Econometric Society, vol. 65(3), pages 557-586, May.
    28. repec:wop:calsdi:96-17 is not listed on IDEAS
    29. Wouter Denhaan & Andrew T. Levin, 1996. "VARHAC Covariance Matrix Estimator (GAUSS)," QM&RBC Codes 64, Quantitative Macroeconomics & Real Business Cycles.
    30. Cochrane, John H., 1991. "A critique of the application of unit root tests," Journal of Economic Dynamics and Control, Elsevier, vol. 15(2), pages 275-284, April.
    31. Johansen, Soren, 1995. "Likelihood-Based Inference in Cointegrated Vector Autoregressive Models," OUP Catalogue, Oxford University Press, number 9780198774501.
    32. Andrews, Donald W K & Monahan, J Christopher, 1992. "An Improved Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimator," Econometrica, Econometric Society, vol. 60(4), pages 953-966, July.
    33. Campbell, Bryan & Dufour, Jean-Marie, 1995. "Exact Nonparametric Orthogonality and Random Walk Tests," The Review of Economics and Statistics, MIT Press, vol. 77(1), pages 1-16, February.
    34. Maddala, G S & Jeong, Jinook, 1992. "On the Exact Small Sample Distribution of the Instrumental Variable Estimator," Econometrica, Econometric Society, vol. 60(1), pages 181-183, January.
    35. Dufour, J.M., 1979. "Rank Tests for Serial Dependence," Cahiers de recherche 7815, Universite de Montreal, Departement de sciences economiques.
    36. Jean-Marie Dufour, 1997. "Some Impossibility Theorems in Econometrics with Applications to Structural and Dynamic Models," Econometrica, Econometric Society, vol. 65(6), pages 1365-1388, November.
    37. Choi, In & Phillips, Peter C. B., 1992. "Asymptotic and finite sample distribution theory for IV estimators and tests in partially identified structural equations," Journal of Econometrics, Elsevier, vol. 51(1-2), pages 113-150.
    38. Phillips, P C B, 1987. "Time Series Regression with a Unit Root," Econometrica, Econometric Society, vol. 55(2), pages 277-301, March.
    39. John Shea, 1997. "Instrument Relevance in Multivariate Linear Models: A Simple Measure," The Review of Economics and Statistics, MIT Press, vol. 79(2), pages 348-352, May.
    40. Sims, Christopher A, 1971. "Discrete Approximations to Continuous Time Distributed Lags in Econometrics," Econometrica, Econometric Society, vol. 39(3), pages 545-563, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jean-Marie Dufour, 2003. "Identification, weak instruments, and statistical inference in econometrics," Canadian Journal of Economics, Canadian Economics Association, vol. 36(4), pages 767-808, November.
    2. Akhabbar, Amanar, 2019. "Introduction : Malaise dans la science économique ? [Introduction: Economics and Its Discontents]," MPRA Paper 93328, University Library of Munich, Germany.
    3. Abdelhamid El Bouhadi, 2003. "Conditional Volatility Of Most Active Shares Of Casablanca Stock Exchange," Finance 0305007, University Library of Munich, Germany, revised 02 Feb 2004.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dufour, Jean-Marie, 2001. "Logique et tests d’hypothèses," L'Actualité Economique, Société Canadienne de Science Economique, vol. 77(2), pages 171-190, juin.
    2. Jean‐Marie Dufour, 2003. "Identification, weak instruments, and statistical inference in econometrics," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 36(4), pages 767-808, November.
    3. Jean-Marie Dufour, 2003. "Identification, weak instruments, and statistical inference in econometrics," Canadian Journal of Economics, Canadian Economics Association, vol. 36(4), pages 767-808, November.
    4. Jean-Marie Dufour & Mohamed Taamouti, 2005. "Projection-Based Statistical Inference in Linear Structural Models with Possibly Weak Instruments," Econometrica, Econometric Society, vol. 73(4), pages 1351-1365, July.
    5. Dufour, Jean-Marie & Khalaf, Lynda & Kichian, Maral, 2006. "Inflation dynamics and the New Keynesian Phillips Curve: An identification robust econometric analysis," Journal of Economic Dynamics and Control, Elsevier, vol. 30(9-10), pages 1707-1727.
    6. Richard Startz & Charles Nelson & Eric Zivot, 1999. "Improved Inference for the Instrumental Variable Estimator," Working Papers 0039, University of Washington, Department of Economics.
    7. Dufour, Jean-Marie & Taamouti, Mohamed, 2007. "Further results on projection-based inference in IV regressions with weak, collinear or missing instruments," Journal of Econometrics, Elsevier, vol. 139(1), pages 133-153, July.
    8. DUFOUR, Jean-Marie & JASIAK, Joanna, 1998. "Finite-Sample Inference Methods for Simultaneous Equations and Models with Unobserved and Generated Regressors," Cahiers de recherche 9812, Universite de Montreal, Departement de sciences economiques.
    9. Benoit Perron, 2003. "Semiparametric Weak-Instrument Regressions with an Application to the Risk-Return Tradeoff," The Review of Economics and Statistics, MIT Press, vol. 85(2), pages 424-443, May.
    10. Chao, John & Swanson, Norman R., 2007. "Alternative approximations of the bias and MSE of the IV estimator under weak identification with an application to bias correction," Journal of Econometrics, Elsevier, vol. 137(2), pages 515-555, April.
    11. Donald W.K. Andrews & James H. Stock, 2005. "Inference with Weak Instruments," NBER Technical Working Papers 0313, National Bureau of Economic Research, Inc.
    12. Paul A. Bekker & Jan van der Ploeg, 2000. "Instrumental Variable Estimation Based on Grouped Data," Econometric Society World Congress 2000 Contributed Papers 1862, Econometric Society.
    13. repec:bla:ecorec:v:91:y:2015:i::p:1-24 is not listed on IDEAS
    14. Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91(S1), pages 1-24, June.
    15. D.S. Poskitt & C.L. Skeels, 2002. "Assessing Instrumental Variable Relevance:An Alternative Measure and Some Exact Finite Sample Theory," Department of Economics - Working Papers Series 862, The University of Melbourne.
    16. D. S. Poskitt & C. L. Skeels, 2004. "Approximating the Distribution of the Instrumental Variables Estimator when the Concentration Parameter is Small," Monash Econometrics and Business Statistics Working Papers 19/04, Monash University, Department of Econometrics and Business Statistics.
    17. Guilhem Bascle, 2008. "Controlling for endogeneity with instrumental variables in strategic management research," Post-Print hal-00576795, HAL.
    18. D.S. Poskitt & C.L. Skeels, 2005. "Small Concentration Asymptotics and Instrumental Variables Inference," Department of Economics - Working Papers Series 948, The University of Melbourne.
    19. Poskitt, D.S. & Skeels, C.L., 2007. "Approximating the distribution of the two-stage least squares estimator when the concentration parameter is small," Journal of Econometrics, Elsevier, vol. 139(1), pages 217-236, July.
    20. Engel, Charles, 2000. "Long-run PPP may not hold after all," Journal of International Economics, Elsevier, vol. 51(2), pages 243-273, August.
    21. Kleibergen, Frank & Zivot, Eric, 2003. "Bayesian and classical approaches to instrumental variable regression," Journal of Econometrics, Elsevier, vol. 114(1), pages 29-72, May.

    More about this item

    Keywords

    Econometrics; statistics; testing. philosophy of science; falsifiability; Popper; parsimony; identification; weak instruments; nonparametric model; time series; autoregressive model; heteroskedasticity; unit root; robust method; non-normality; ill-defined problem; Économétrie; statistique; théorie des tests; philosophie des sciences; falsifiabilité; Popper; parcimonie; identification; instruments faibles; modèle non paramétrique; séries chronologiques; modèle autorégressif; hétéroscédasticité; racine unitaire; méthode robuste; non-normalité; problème mal posé;
    All these keywords.

    JEL classification:

    • B23 - Schools of Economic Thought and Methodology - - History of Economic Thought since 1925 - - - Econometrics; Quantitative and Mathematical Studies
    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C20 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cir:cirwor:2001s-40. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Webmaster (email available below). General contact details of provider: https://edirc.repec.org/data/ciranca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.