Nonparametric Regression in Natural Exponential Families
Nonparametric Regression in Natural Exponential Families
- Abstract: Theory and methodology for nonparametric regression have been particularly well developed in the case of additive homoscedastic Gaussian noise. Inspired by the asymptotic equivalence theory, there have been ongoing efforts in recent years to construct explicit procedures that turn other function estimation problems into a standard nonparametric regression with Gaussian noise. Then in principle any good Gaussian nonparametric regression method can be used to solve those more complicated nonparametric models. In particular, Brown, Cai and Zhou (2010) considered nonparametric regression in the natural exponential families with a quadratic variance function.
In this paper we extend the scope of Brown, Cai and Zhou (2010) to general natural exponential families by introducing a new explicit procedure that is based on the variance stabilizing transformation. The new approach significantly reduces the bias of the inverse transformation and as a consequence it enables the method to be applicable to a wider class of exponential families. Combining this procedure with a wavelet block thresholding estimator for Gaussian nonparametric regression, we show that the resulting estimator enjoys a high degree of adaptivity and spatial adaptivity with near-optimal asymptotic performance over a broad range of Besov spaces.
- Paper: pdf file.
- Other related papers:
Cai, T. (1999).
Adaptive wavelet estimation: a block thresholding and oracle inequality approach.
The Annals of Statistics 27, 898-924.
- Brown, L. D., Cai, T., Zhang, R., Zhao, L. & Zhou, H. (2007).
The root-unroot algorithm for density estimation as implemented via wavelet block thresholding.
Probability Theory and Related Fields , to appear.
- Brown, L. D., Cai, T. & Zhou, H. (2008).
Robust nonparametric estimation via wavelet median regression.
The Annals of Statistics 36, 2055-2084.
- Brown, L. D., Cai, T. & Zhou, H. (2009).
Nonparametric regression in exponential families.
The Annals of Statistics, to appear.
- Cai, T. & Zhou, H. (2009).
Asymptotic equivalence and adaptive estimation for robust nonparametric regression.
The Annals of Statistics 37, 3204-3235.