Tuning-parameter selection in regularized estimations of large covariance matrices

Recently many regularized estimators of large covariance matrices have been proposed, and the tuning parameters in these estimators are usually selected via cross-validation. However, there is a lack of consensus on the number of folds for conducting cross-validation. One round of cross-validation involves partitioning a sample of data into two complementary subsets, a training set and a validation set. In this manuscript, we demonstrate that if the estimation accuracy is measured in the Frobenius norm, the training set should consist of majority of the data; whereas if the estimation accuracy is measured in the operator norm, the validation set should consist of majority of the data. We also develop methods for selecting tuning parameters based on the bootstrap and compare them with their cross-validation counterparts. We demonstrate that the cross-validation methods with ‘optimal’ choices of folds are more appropriate than their bootstrap counterparts.

• Publication year

  2013

• Venue

  Journal of Statistical Computation and Simulation

• Publication date

  2013-08-15

• Fields of study

  Mathematics

• Identifiers
  DOI 10.1080/00949655.2015.1017823arXiv 1308.3416
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• On the theoretic and practical merits of the banding estimator for large covariance matrices

  2014cited by this paper
• Consistent Cross-Validation for Tuning Parameter Selection in High-Dimensional Variable Selection

  2013cited by this paper
• SURE-tuned tapering estimation of large covariance matrices

  2013influential reference
• Positive Definite $\ell_1$ Penalized Estimation of Large Covariance Matrices

  2012cited by this paper
• Topics in Random Matrix Theory

  2012cited by this paper
• Large covariance estimation by thresholding principal orthogonal complements

  2011cited by this paper
• Optimal rates of convergence for covariance matrix estimation

  2010cited by this paper
• A new approach to Cholesky-based covariance regularization in high dimensions

  2009cited by this paper
• Linear Model Selection by Cross-validation

  2009cited by this paper
• Covariance regularization by thresholding

  2009influential reference
• BANDING SAMPLE AUTOCOVARIANCE MATRICES OF STATIONARY PROCESSES

  2009cited by this paper
• Generalized Thresholding of Large Covariance Matrices

  2009cited by this paper
• Regularized estimation of large covariance matrices

  2008influential reference
• Operator norm consistent estimation of large-dimensional sparse covariance matrices

  2008cited by this paper
• Sparsistency and Rates of Convergence in Large Covariance Matrix Estimation.

  2007cited by this paper
• Estimation of high-dimensional prior and posterior covariance matrices in Kalman filter variants

  2007cited by this paper
• High dimensional covariance matrix estimation using a factor model

  2007cited by this paper
• Lung metastasis genes couple breast tumor size and metastatic spread

  2007cited by this paper
• Covariance matrix selection and estimation via penalised normal likelihood

  2006cited by this paper
• Gene-expression profiles to predict distant metastasis of lymph-node-negative primary breast cancer.

  2005cited by this paper
• On the distribution of the largest eigenvalue in principal components analysis

  2001cited by this paper
• Smoothed functional principal components analysis by choice of norm

  1996influential reference
• A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection

  1995cited by this paper
• Cross‐Validatory Choice and Assessment of Statistical Predictions

  1976cited by this paper

• A Class of Structured High-Dimensional Dynamic Covariance Matrices

  2023cites this paper
• Efficient nonparametric estimation of Toeplitz covariance matrices

  2023cites this paper
• Sparse covariance matrix estimation for ultrahigh dimensional data

  2022cites this paper
• A proximal distance algorithm for likelihood-based sparse covariance estimation.

  2021cites this paper
• Cross-Validated Loss-based Covariance Matrix Estimator Selection in High Dimensions

  2021cites this paper
• Nonparametric covariance estimation with shrinkage toward stationary models

  2020cites this paper
• High-Dimensional Dynamic Covariance Matrices With Homogeneous Structure

  2020cites this paper
• Threshold selection for covariance estimation

  2019cites this paper
• A multiple testing approach to the regularisation of large sample correlation matrices

  2019cites this paper
• ESTIMATION OF LARGE COVARIANCE AND PRECISION MATRICES FROM TEMPORALLY DEPENDENT OBSERVATIONS

  2019cites this paper
• Estimating a covariance matrix for market risk management and the case of credit default swaps

  2018cites this paper
• Advances in Credit Risk Modeling

  2017cites this paper
• Estimation of covariance and precision matrix, network structure, and a view toward systems biology

  2017cites this paper
• High Dimensional Dependent Data Analysis for Neuroimaging.

  2016influential citation
• Analyzing allele specific RNA expression using mixture models

  2015cites this paper
• Supplementary appendix to: A multiple testing approach to the regularisation of large sample correlation matrices

  2015cites this paper
• The minimum S-divergence estimator under continuous models: the Basu–Lindsay approach

  2014cites this paper
• Large covariance/correlation matrix estimation for long memory temporal data

  2014influential citation
• Estimation of large covariance and precision matrices from temporally dependent observations

  2014cites this paper
• HKBU Institutional Repository

  year unknowncites this paper