Nothing Special   »   [go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/tky/fseres/2014cf933.html
   My bibliography  Save this paper

Tests for Covariance Matrices in High Dimension with Less Sample Size

Author

Listed:
  • Muni S. Srivastava

    (Department of Statistics, University of Toronto)

  • Hirokazu Yanagihara

    (Department of Mathematics, Hiroshima University)

  • Tatsuya Kubokawa

    (Faculty of Economics, The University of Tokyo)

Abstract
In this article, we propose tests for covariance matrices of high dimension with fewer observations than the dimension for a general class of distributions with positive definite covariance matrices. In one-sample case, tests are proposed for sphericity and for testing the hypothesis that the covariance matrix ∑ is an identity matrix, by providing an unbiased estimator of tr [∑ 2 ] under the general model which requires no more computing time than the one available in the literature for normal model. In the two-sample case, tests for the equality of two covariance matrices are given. The asymptotic distributions of proposed tests in one-sample case are derived under the assumption that the sample size N = O ( p δ ), 1/2 < δ < 1, where p is the dimension of the random vector, and O ( p δ ) means that N/p goes to zero as N and p go to infinity. Similar assumptions are made in the two-sample case.

Suggested Citation

  • Muni S. Srivastava & Hirokazu Yanagihara & Tatsuya Kubokawa, 2014. "Tests for Covariance Matrices in High Dimension with Less Sample Size," CIRJE F-Series CIRJE-F-933, CIRJE, Faculty of Economics, University of Tokyo.
    • Handle: RePEc:tky:fseres:2014cf933
    as

    Download full text from publisher

    File URL: http://www.cirje.e.u-tokyo.ac.jp/research/dp/2014/2014cf933.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Rauf Ahmad, M. & Werner, C. & Brunner, E., 2008. "Analysis of high-dimensional repeated measures designs: The one sample case," Computational Statistics & Data Analysis, Elsevier, vol. 53(2), pages 416-427, December.
    2. Alexei Onatski & Marcelo Moreira J. & Marc Hallin, 2011. "Asymptotic Power of Sphericity Tests for High-Dimensional Data," Working Papers ECARES ECARES 2011-018, ULB -- Universite Libre de Bruxelles.
    3. Srivastava, Muni S., 2009. "A test for the mean vector with fewer observations than the dimension under non-normality," Journal of Multivariate Analysis, Elsevier, vol. 100(3), pages 518-532, March.
    4. Srivastava, Muni S. & Kollo, Tõnu & von Rosen, Dietrich, 2011. "Some tests for the covariance matrix with fewer observations than the dimension under non-normality," Journal of Multivariate Analysis, Elsevier, vol. 102(6), pages 1090-1103, July.
    5. Tony Cai & Weidong Liu & Yin Xia, 2013. "Two-Sample Covariance Matrix Testing and Support Recovery in High-Dimensional and Sparse Settings," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(501), pages 265-277, March.
    6. Chen, Song Xi & Zhang, Li-Xin & Zhong, Ping-Shou, 2010. "Tests for High-Dimensional Covariance Matrices," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 810-819.
    7. Fan, Jianqing & Hall, Peter & Yao, Qiwei, 2007. "To How Many Simultaneous Hypothesis Tests Can Normal, Student's t or Bootstrap Calibration Be Applied?," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1282-1288, December.
    8. Srivastava, Muni S. & Du, Meng, 2008. "A test for the mean vector with fewer observations than the dimension," Journal of Multivariate Analysis, Elsevier, vol. 99(3), pages 386-402, March.
    9. Srivastava, Muni S. & Katayama, Shota & Kano, Yutaka, 2013. "A two sample test in high dimensional data," Journal of Multivariate Analysis, Elsevier, vol. 114(C), pages 349-358.
    10. Chen, Songxi, 2012. "Two Sample Tests for High Dimensional Covariance Matrices," MPRA Paper 46026, University Library of Munich, Germany.
    11. Schott, James R., 2007. "A test for the equality of covariance matrices when the dimension is large relative to the sample sizes," Computational Statistics & Data Analysis, Elsevier, vol. 51(12), pages 6535-6542, August.
    12. Baik, Jinho & Silverstein, Jack W., 2006. "Eigenvalues of large sample covariance matrices of spiked population models," Journal of Multivariate Analysis, Elsevier, vol. 97(6), pages 1382-1408, July.
    13. Srivastava, Muni S. & Kubokawa, Tatsuya, 2013. "Tests for multivariate analysis of variance in high dimension under non-normality," Journal of Multivariate Analysis, Elsevier, vol. 115(C), pages 204-216.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wang, Zhendong & Xu, Xingzhong, 2021. "Testing high dimensional covariance matrices via posterior Bayes factor," Journal of Multivariate Analysis, Elsevier, vol. 181(C).
    2. Li, Yang & Wang, Zhaojun & Zou, Changliang, 2016. "A simpler spatial-sign-based two-sample test for high-dimensional data," Journal of Multivariate Analysis, Elsevier, vol. 149(C), pages 192-198.
    3. Tsukuda, Koji & Matsuura, Shun, 2019. "High-dimensional testing for proportional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 171(C), pages 412-420.
    4. Yuki Ikeda & Tatsuya Kubokawa & Muni S. Srivastava, 2015. "Comparison of Linear Shrinkage Estimators of a Large Covariance Matrix in Normal and Non-normal Distributions," CIRJE F-Series CIRJE-F-970, CIRJE, Faculty of Economics, University of Tokyo.
    5. Angulo, Ana & Burridge, Peter & Mur, Jesús, 2018. "Testing for breaks in the weighting matrix," Regional Science and Urban Economics, Elsevier, vol. 68(C), pages 115-129.
    6. Xu, Kai & Hao, Xinxin, 2019. "A nonparametric test for block-diagonal covariance structure in high dimension and small samples," Journal of Multivariate Analysis, Elsevier, vol. 173(C), pages 551-567.
    7. Butucea, Cristina & Zgheib, Rania, 2016. "Sharp minimax tests for large Toeplitz covariance matrices with repeated observations," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 164-176.
    8. Ikeda, Yuki & Kubokawa, Tatsuya & Srivastava, Muni S., 2016. "Comparison of linear shrinkage estimators of a large covariance matrix in normal and non-normal distributions," Computational Statistics & Data Analysis, Elsevier, vol. 95(C), pages 95-108.
    9. Peng, Liuhua & Chen, Song Xi & Zhou, Wen, 2016. "More powerful tests for sparse high-dimensional covariances matrices," Journal of Multivariate Analysis, Elsevier, vol. 149(C), pages 124-143.
    10. Hayakawa, Kazuhiko, 2024. "Recent development of covariance structure analysis in economics," Econometrics and Statistics, Elsevier, vol. 29(C), pages 31-48.
    11. Deepak Nag Ayyala & Santu Ghosh & Daniel F. Linder, 2022. "Covariance matrix testing in high dimension using random projections," Computational Statistics, Springer, vol. 37(3), pages 1111-1141, July.
    12. Zhendong Wang & Xingzhong Xu, 2021. "High-dimensional sphericity test by extended likelihood ratio," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 84(8), pages 1169-1212, November.
    13. Mao, Guangyu, 2016. "A note on tests for high-dimensional covariance matrices," Statistics & Probability Letters, Elsevier, vol. 117(C), pages 89-92.
    14. Zheng, Bang Quan, 2021. "RGLS and RLS in Covariance Structure Analysis," SocArXiv aejgf, Center for Open Science.
    15. Yamada, Yuki & Hyodo, Masashi & Nishiyama, Takahiro, 2017. "Testing block-diagonal covariance structure for high-dimensional data under non-normality," Journal of Multivariate Analysis, Elsevier, vol. 155(C), pages 305-316.
    16. Imbs, Jean & Pauwels, Laurent, 2019. "Fundamental Moments," Working Papers BAWP-2019-06, University of Sydney Business School, Discipline of Business Analytics.
    17. Masashi Hyodo & Takahiro Nishiyama, 2018. "A simultaneous testing of the mean vector and the covariance matrix among two populations for high-dimensional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 27(3), pages 680-699, September.
    18. Xu, Kai & Tian, Yan & He, Daojiang, 2021. "A high dimensional nonparametric test for proportional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 184(C).
    19. Long Feng & Changliang Zou & Zhaojun Wang, 2016. "Multivariate-Sign-Based High-Dimensional Tests for the Two-Sample Location Problem," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(514), pages 721-735, April.
    20. Tsukuda, Koji & Matsuura, Shun, 2021. "Limit theorem associated with Wishart matrices with application to hypothesis testing for common principal components," Journal of Multivariate Analysis, Elsevier, vol. 186(C).
    21. Laíla Luana Campos & Daniel Furtado Ferreira, 2022. "Robust modified classical spherical tests in the presence of outliers," Statistical Papers, Springer, vol. 63(5), pages 1561-1576, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Davy Paindaveine & Thomas Verdebout, 2013. "Universal Asymptotics for High-Dimensional Sign Tests," Working Papers ECARES ECARES 2013-40, ULB -- Universite Libre de Bruxelles.
    2. Jiang Hu & Zhidong Bai & Chen Wang & Wei Wang, 2017. "On testing the equality of high dimensional mean vectors with unequal covariance matrices," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 69(2), pages 365-387, April.
    3. Harrar, Solomon W. & Kong, Xiaoli, 2022. "Recent developments in high-dimensional inference for multivariate data: Parametric, semiparametric and nonparametric approaches," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    4. Thulin, Måns, 2014. "A high-dimensional two-sample test for the mean using random subspaces," Computational Statistics & Data Analysis, Elsevier, vol. 74(C), pages 26-38.
    5. Yin, Yanqing, 2021. "Test for high-dimensional mean vector under missing observations," Journal of Multivariate Analysis, Elsevier, vol. 186(C).
    6. Huiqin Li & Jiang Hu & Zhidong Bai & Yanqing Yin & Kexin Zou, 2017. "Test on the linear combinations of mean vectors in high-dimensional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 26(1), pages 188-208, March.
    7. Li, Weiming & Qin, Yingli, 2014. "Hypothesis testing for high-dimensional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 128(C), pages 108-119.
    8. Jamshid Namdari & Debashis Paul & Lili Wang, 2021. "High-Dimensional Linear Models: A Random Matrix Perspective," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 83(2), pages 645-695, August.
    9. Zhang, Jin-Ting & Zhu, Tianming, 2022. "A new normal reference test for linear hypothesis testing in high-dimensional heteroscedastic one-way MANOVA," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    10. Ley, Christophe & Paindaveine, Davy & Verdebout, Thomas, 2015. "High-dimensional tests for spherical location and spiked covariance," Journal of Multivariate Analysis, Elsevier, vol. 139(C), pages 79-91.
    11. Tao Zhang & Zhiwen Wang & Yanling Wan, 2021. "Functional test for high-dimensional covariance matrix, with application to mitochondrial calcium concentration," Statistical Papers, Springer, vol. 62(3), pages 1213-1230, June.
    12. Deepak Nag Ayyala & Santu Ghosh & Daniel F. Linder, 2022. "Covariance matrix testing in high dimension using random projections," Computational Statistics, Springer, vol. 37(3), pages 1111-1141, July.
    13. Xie, Jichun & Kang, Jian, 2017. "High-dimensional tests for functional networks of brain anatomic regions," Journal of Multivariate Analysis, Elsevier, vol. 156(C), pages 70-88.
    14. Long Feng & Changliang Zou & Zhaojun Wang, 2016. "Multivariate-Sign-Based High-Dimensional Tests for the Two-Sample Location Problem," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(514), pages 721-735, April.
    15. Wang, Cheng, 2014. "Asymptotic power of likelihood ratio tests for high dimensional data," Statistics & Probability Letters, Elsevier, vol. 88(C), pages 184-189.
    16. Chen, Song Xi & Guo, Bin & Qiu, Yumou, 2023. "Testing and signal identification for two-sample high-dimensional covariances via multi-level thresholding," Journal of Econometrics, Elsevier, vol. 235(2), pages 1337-1354.
    17. Anders Bredahl Kock & David Preinerstorfer, 2019. "Power in High‐Dimensional Testing Problems," Econometrica, Econometric Society, vol. 87(3), pages 1055-1069, May.
    18. Zhang, Jin-Ting & Guo, Jia & Zhou, Bu, 2017. "Linear hypothesis testing in high-dimensional one-way MANOVA," Journal of Multivariate Analysis, Elsevier, vol. 155(C), pages 200-216.
    19. Tiefeng Jiang & Yongcheng Qi, 2015. "Likelihood Ratio Tests for High-Dimensional Normal Distributions," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 42(4), pages 988-1009, December.
    20. Ayyala, Deepak Nag & Park, Junyong & Roy, Anindya, 2017. "Mean vector testing for high-dimensional dependent observations," Journal of Multivariate Analysis, Elsevier, vol. 153(C), pages 136-155.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tky:fseres:2014cf933. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CIRJE administrative office (email available below). General contact details of provider: https://edirc.repec.org/data/ritokjp.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.