Minimax Estimation of Large Covariance Matrices under l1 Norm
Minimax Estimation of Large Covariance Matrices under l1 Norm
- Abstract: Driven by a wide range of applications in high-dimensional data analysis, there has been significant recent interest in the estimation of large covariance matrices. In this paper, we consider optimal estimation of a covariance matrix as well as its inverse over several commonly used parameter spaces under the matrix l1 norm. Both minimax lower and upper bounds are derived.
The lower bounds are established by using hypothesis testing arguments, where at the core are a novel construction of collections of least favorable multivariate normal distributions and bounding the affinities between pairs of distributions. The lower bound analysis also provides insight into where the difficulties of the covariance matrix estimation problem come from.
Specific thresholding estimator and tapering estimator are constructed and shown to be minimax rate optimal. The optimal rates of convergence established in the paper can serve as a benchmark for the performance of covariance matrix estimation methods.
- Paper: pdf file.
- Other related paper:
- Cai, T., Zhang, C.-H. & Zhou, H. (2009).
Optimal rates of convergence for covariance matrix estimation
The Annals of Statistics, to appear.