Testing Composite Hypotheses, Hermite Polynomials, and Optimal Estimation of a Nonsmooth Functional
Tony Cai and Mark Low
-
Abstract:
A general lower bound is developed for the minimax risk when
estimating an arbitrary functional. The bound is based on testing two
composite hypotheses and is shown to be effective in estimating the
non-smooth functional n-1 Σ |θi|
from an observation Y ~ N(θ, In).
This problem exhibits some features that are
significantly different from those that occur in estimating conventional
smooth functionals. This is a setting where standard
techniques fail to yield sharp results.
A sharp minimax lower bound is established by applying the general lower bound technique based on testing two fuzzy hypotheses. A key step is the construction of two special priors and bounding the chi-square distance between two normal mixtures. An estimator is constructed using approximation theory and Hermite polynomials and is shown to be asymptotically sharp minimax when the means are bounded by a given value M. It is shown that the minimax risk equals β* 2 M2 (loglog n)2/(log n)2 asymptotically, where β* is the Bernstein constant.
The general techniques and results developed in the present paper can also be used to solve other related problems.
- Paper:
pdf file.
- Other related papers:
Cai, T. & Low, M. (2004).
Minimax estimation of linear functionals over nonconvex parameter spaces.
The Annals of Statistics 32, 552 - 576.Cai, T. & Low, M. (2005).
Non-quadratic estimators of a quadratic functional.
The Annals of Statistics 33, 2930-2956.