Skip to Main content Skip to Navigation
Journal articles

A Proximal Point Algorithm for Minimum Divergence Estimators with Application to Mixture Models

Abstract : Estimators derived from a divergence criterion such as ϕ−divergences are generally more robust than the maximum likelihood ones. We are interested in particular in the so-called minimum dual ϕ–divergence estimator (MDϕDE), an estimator built using a dual representation of ϕ–divergences. We present in this paper an iterative proximal point algorithm that permits the calculation of such an estimator. The algorithm contains by construction the well-known Expectation Maximization (EM) algorithm. Our work is based on the paper of Tseng on the likelihood function. We provide some convergence properties by adapting the ideas of Tseng. We improve Tseng's results by relaxing the identifiability condition on the proximal term, a condition which is not verified for most mixture models and is hard to be verified for " non mixture " ones. Convergence of the EM algorithm in a two-component Gaussian mixture is discussed in the spirit of our approach. Several experimental results on mixture models are provided to confirm the validity of the approach.
Document type :
Journal articles
Complete list of metadatas

Cited literature [22 references]  Display  Hide  Download
Contributor : Gestionnaire Hal-Upmc <>
Submitted on : Monday, October 3, 2016 - 11:00:02 AM
Last modification on : Thursday, March 21, 2019 - 1:12:17 PM
Long-term archiving on: : Friday, February 3, 2017 - 1:52:18 PM


Publication funded by an institution


Distributed under a Creative Commons Attribution 4.0 International License



Diaa Al Mohamad, Michel Broniatowski. A Proximal Point Algorithm for Minimum Divergence Estimators with Application to Mixture Models. Entropy, MDPI, 2016, 18 (8), pp.277. ⟨10.3390/e18080277⟩. ⟨hal-01375424⟩