Nothing Special   »   [go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/ifs/cemmap/76-13.html
   My bibliography  Save this paper

Gaussian approximations and multiplier bootstrap for maxima of sums of high-dimensional random vectors

Author

Listed:
  • Victor Chernozhukov

    (Institute for Fiscal Studies and MIT)

  • Denis Chetverikov

    (Institute for Fiscal Studies and UCLA)

  • Kengo Kato

    (Institute for Fiscal Studies)

Abstract
We derive a Gaussian approximation result for the maximum of a sum of high dimensional random vectors. Specifically, we establish conditions under which the distribution of the maximum is approximated by that of the maximum of a sum of the Gaussian random vectors with the same covariance matrices as the original vectors. This result applies when the dimension of random vectors (p) is large compared to the sample size (n); in fact, p can be much larger than n, without restricting correlations of the coordinates of these vectors. We also show that the distribution of the maximum of a sum of the random vectors with unknown covariance matrices can be consistently estimated by the distribution of the maximum of a sum of the conditional Gaussian random vectors obtained by multiplying the original vectors with i.i.d. Gaussian multipliers. This is the Gaussian multiplier (or wild) bootstrap procedure. Here too, p can be large or even much larger than n. These distributional approximations, either Gaussian or conditional Gaussian, yield a high-quality approximation to the distribution of the original maximum, often with approximation error decreasing polynomially in the sample size, and hence are of interest in many applications. We demonstrate how our Gaussian approximations and the multiplier bootstrap can be used for modern high dimensional estimation, multiple hypothesis testing, and adaptive specification testing. All these results contain non-asymptotic bounds on approximation errors.

Suggested Citation

  • Victor Chernozhukov & Denis Chetverikov & Kengo Kato, 2013. "Gaussian approximations and multiplier bootstrap for maxima of sums of high-dimensional random vectors," CeMMAP working papers CWP76/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    • Handle: RePEc:ifs:cemmap:76/13
    as

    Download full text from publisher

    File URL: http://www.cemmap.ac.uk/wps/cwp761313.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Victor Chernozhukov & Denis Chetverikov & Kengo Kato, 2012. "Gaussian approximation of suprema of empirical processes," CeMMAP working papers CWP44/12, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    2. Horowitz, Joel L & Spokoiny, Vladimir G, 2001. "An Adaptive, Rate-Optimal Test of a Parametric Mean-Regression Model against a Nonparametric Alternative," Econometrica, Econometric Society, vol. 69(3), pages 599-631, May.
    3. Emmanuel Guerre & Pascal Lavergne, 2004. "Data-Driven Rate-Optimal Specification Testing In Regression Models," Econometrics 0411008, University Library of Munich, Germany.
    4. Yosef Rinott & Vladimir Rotar, 2000. "Normal approximations by Stein's method," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 23(1), pages 15-29.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Victor Chernozhukov & Denis Chetverikov & Kengo Kato, 2012. "Central limit theorems and multiplier bootstrap when p is much larger than n," CeMMAP working papers CWP45/12, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    2. Long Feng & Changliang Zou & Zhaojun Wang & Lixing Zhu, 2015. "Robust comparison of regression curves," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 24(1), pages 185-204, March.
    3. Andrea Vaona, 2008. "The sensitivity of nonparametric misspecification tests to disturbance autocorrelation," Quaderni della facoltà di Scienze economiche dell'Università di Lugano 0803, USI Università della Svizzera italiana.
    4. Masamune Iwasawa, 2015. "A Joint Specification Test for Response Probabilities in Unordered Multinomial Choice Models," Econometrics, MDPI, vol. 3(3), pages 1-31, September.
    5. Stefan Sperlich, 2013. "Comments on: An updated review of Goodness-of-Fit tests for regression models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 22(3), pages 419-427, September.
    6. Lopez, O. & Patilea, V., 2009. "Nonparametric lack-of-fit tests for parametric mean-regression models with censored data," Journal of Multivariate Analysis, Elsevier, vol. 100(1), pages 210-230, January.
    7. Stefan Sperlich, 2014. "On the choice of regularization parameters in specification testing: a critical discussion," Empirical Economics, Springer, vol. 47(2), pages 427-450, September.
    8. Wenceslao González-Manteiga & Rosa Crujeiras, 2013. "An updated review of Goodness-of-Fit tests for regression models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 22(3), pages 361-411, September.
    9. Mora, Juan & Moro-Egido, Ana I., 2008. "On specification testing of ordered discrete choice models," Journal of Econometrics, Elsevier, vol. 143(1), pages 191-205, March.
    10. Alexandre Belloni & Victor Chernozhukov & Kengo Kato, 2019. "Valid Post-Selection Inference in High-Dimensional Approximately Sparse Quantile Regression Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(526), pages 749-758, April.
    11. Christoph Breunig, 2019. "Goodness-of-Fit Tests based on Series Estimators in Nonparametric Instrumental Regression," Papers 1909.10133, arXiv.org.
    12. Patrick Saart & Jiti Gao & Nam Hyun Kim, 2014. "Semiparametric methods in nonlinear time series analysis: a selective review," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 26(1), pages 141-169, March.
    13. Olivier Collier & Arnak S, Dalalyan, 2013. "Curve registration by Nonparametric goodness-of-fit Testing," Working Papers 2013-33, Center for Research in Economics and Statistics.
    14. Pipat Wongsaart & Jiti Gao, 2011. "Nonparametric Kernel Testing in Semiparametric Autoregressive Conditional Duration Model," Monash Econometrics and Business Statistics Working Papers 18/11, Monash University, Department of Econometrics and Business Statistics.
    15. Chen, Song Xi & Gao, Jiti & Tang, Chenghong, 2005. "A test for model specification of diffusion processes," MPRA Paper 11976, University Library of Munich, Germany, revised Feb 2007.
    16. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2008. "Nonparametric Tests for Treatment Effect Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 389-405, August.
    17. Weichi Wu & Zhou Zhou, 2017. "Nonparametric Inference for Time-Varying Coefficient Quantile Regression," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(1), pages 98-109, January.
    18. Alexandre Belloni & Victor Chernozhukov & Ivan Fernandez-Val & Christian Hansen, 2013. "Program evaluation with high-dimensional data," CeMMAP working papers CWP77/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    19. Jia-Young Michael Fu & Joel L. Horowitz & Matthias Parey, 2015. "Testing exogeneity in nonparametric instrumental variables identified by conditional quantile restrictions," CeMMAP working papers 68/15, Institute for Fiscal Studies.
    20. Heckman, James J. & Schmierer, Daniel & Urzua, Sergio, 2010. "Testing the correlated random coefficient model," Journal of Econometrics, Elsevier, vol. 158(2), pages 177-203, October.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:76/13. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emma Hyman (email available below). General contact details of provider: https://edirc.repec.org/data/cmifsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.