Nonparametric Estimation of Conditional Information and Divergences (2012)

Abstract

In this paper we propose new nonparametric estimators for a family of conditional mutual information and divergences. Our estimators are easy to compute; they only use simple k nearest neighbor based statistics. We prove that the proposed conditional information and divergence estimators are consistent under certain conditions, and demonstrate their consistency and applicability by numerical experiments on simulated and on real data as well

Full text

Download (application/pdf, 574.4 kB)

Approximate BibTeX Entry

@inproceedings{poczos12AISTATS,
    Howpublished = {AISTATS 2012},
    Year = {2012},
    Booktitle = {AISTATS 2012},
    Author = { Barnabas Poczos, Jeff Schneider },
    Title = {Nonparametric Estimation of Conditional Information and Divergences}
}