Document Type
Technical Report
Publication Date
12-1-2014
Technical Report Number
TR2014-765
Abstract
This paper is concerned with the information-theoretical limits of density estimation for Gaussian random variables with data drawn independently and with identical distributions. We apply Fano's inequality to the space of densities and an arbitrary estimator. We derive necessary conditions on the sample size for reliable density recovery and for reliable density estimation. These conditions are true simultaneously for both finitely and infinitely dimensional density spaces.
Dartmouth Digital Commons Citation
Brofos, James, "Information-Theoretic Limits for Density Estimation" (2014). Computer Science Technical Report TR2014-765. https://digitalcommons.dartmouth.edu/cs_tr/365