Optimal Estimation and Rank Detection for Sparse Spiked Covariance Matrices
Tony Cai, Zongming Ma and Yihong Wu
-
Abstract:
This paper considers sparse spiked covariance matrix models in the high-dimensional setting and studies the minimax estimation of the covariance matrix and the principal subspace as well as the minimax rank detection. The optimal rate of convergence for estimating the spiked covariance matrix under the spectral norm is established, which requires significantly different techniques from those for estimating other structured covariance matrices such as bandable or sparse covariance matrices. We also establish the minimax rate under the spectral norm for estimating the principal subspace, the primary object of interest in principal component analysis. In addition, the optimal rate for the rank detection boundary is obtained. This result also resolves a gap between the upper and lower bounds in a recent paper by Berthet and Rigollet [1] where the special case of rank one is considered.
- Paper:
pdf file.
- Other related papers:
Cai, T., Zhang, C.-H. & Zhou, H. (2010).
Optimal rates of convergence for covariance matrix estimation
The Annals of Statistics 38, 2118-2144.Cai, T., Liu, W. & Luo, X. (2011).
A constrained l1 minimization approach to sparse precision matrix estimation.
J. American Statistical Association 106, 594-607.Cai, T. & Liu, W. (2011).
Adaptive thresholding for sparse covariance matrix estimation.
J. American Statistical Association 106, 672-684.Cai, T. & Zhou, H. (2012).
Minimax estimation of large covariance matrices under l1 norm (with discussion).
Statistica Sinica 22, 1319-1378.Cai, T. & Yuan, M. (2012).
Adaptive covariance matrix estimation through block thresholding.
The Annals of Statistics 40, 2014-2042.Cai, T. & Zhou, H. (2012).
Optimal rates of convergence for sparse covariance matrix estimation.
The Annals of Statistics 40, 2389-2420. .Cai, T., Ren, Z. & Zhou, H. (2013).
Optimal rates of convergence for estimating Toeplitz covariance matrices.
Probability Theory and Related Fields 156, 101-143.Cai, T., Ma, Z. & Wu, Y. (2013).
Sparse PCA: Optimal rates and adaptive estimation.
The Annals of Statistics 42, 722-750.