Showing 1–4 of 4 results for author: Ba, A D

Non parametric estimation of joint, Renyi-Stallis entropies and mutual information and asymptotic limits

Authors: Amadou Diadie Ba, Gane Samb Lo, Cheikh Tidiane Seck

Abstract: This paper proposes a new method for estimating the joint probability mass function of a pair of discrete random variables. This estimator is used to construct joint Shannon Rényi-Tsallis entropies, and the mutual information estimates of a pair of discrete random variables. Almost sure consistency and central limit Theorems are established. Our theorical results are validated by simulations. This paper proposes a new method for estimating the joint probability mass function of a pair of discrete random variables. This estimator is used to construct joint Shannon Rényi-Tsallis entropies, and the mutual information estimates of a pair of discrete random variables. Almost sure consistency and central limit Theorems are established. Our theorical results are validated by simulations. △ Less

Submitted 10 January, 2020; v1 submitted 15 June, 2019; originally announced June 2019.

Comments: 20 pages, 4 figures

Entropies and their Asymptotic Theory in the discrete case

Authors: Amadou Diadie Ba, Gane Samb Lo

Abstract: We present some new nonparametric estimators of entropies and we establish almost sure consistency and central limit Theorems for some of the most important entropies in the discrete case. Our theorical results are validated by simulations. We present some new nonparametric estimators of entropies and we establish almost sure consistency and central limit Theorems for some of the most important entropies in the discrete case. Our theorical results are validated by simulations. △ Less

Submitted 19 March, 2019; originally announced March 2019.

Comments: 18 pages, 4 figures

Divergence Measures Estimation and Its Asymptotic Normality Theory Using Wavelets Empirical Processes

Authors: Gane Samb Lo, Amadou Diadié Ba, Diam Ba

Abstract: In this paper we provide the asymptotic theory of the general of $φ$-divergences measures, which includes the most common divergence measures : Renyi and Tsallis families and the Kullback-Leibler measure. Instead of using the Parzen nonparametric estimators of the probability density functions whose discrepancy is estimated, we use the wavelets approach and the geometry of Besov spaces. One-sided… ▽ More In this paper we provide the asymptotic theory of the general of $φ$-divergences measures, which includes the most common divergence measures : Renyi and Tsallis families and the Kullback-Leibler measure. Instead of using the Parzen nonparametric estimators of the probability density functions whose discrepancy is estimated, we use the wavelets approach and the geometry of Besov spaces. One-sided and two-sided statistical tests are derived as well as symmetrized estimators. Almost sure rates of convergence and asymptotic normality theorem are obtained in the general case, and next particularized for the Renyi and Tsallis families and for the Kullback-Leibler measure as well. The applicability of the results to usual distribution functions is addressed. △ Less

Submitted 14 April, 2017; originally announced April 2017.

Comments: 33 pages

Consistency Bands for divergences measures

Authors: Amadou Diadie Ba

Abstract: By wavelets approach we estimate densities. Then by means of mean value theorem we establish asymptotic consistency and normality for special divergence measures and construct their consistency bands. By wavelets approach we estimate densities. Then by means of mean value theorem we establish asymptotic consistency and normality for special divergence measures and construct their consistency bands. △ Less

Submitted 17 August, 2016; v1 submitted 14 April, 2016; originally announced April 2016.

Comments: 24 pages