Initializing the em algorithm in Gaussian mixture models with an unknown number of components

Volodymyr Melnykov, Igor Melnykov

Research output: Contribution to journalArticlepeer-review

69 Scopus citations

Abstract

An approach is proposed for initializing the expectationmaximization (EM) algorithm in multivariate Gaussian mixture models with an unknown number of components. As the EM algorithm is often sensitive to the choice of the initial parameter vector, efficient initialization is an important preliminary process for the future convergence of the algorithm to the best local maximum of the likelihood function. We propose a strategy initializing mean vectors by choosing points with higher concentrations of neighbors and using a truncated normal distribution for the preliminary estimation of dispersion matrices. The suggested approach is illustrated on examples and compared with several other initialization methods.

Original languageEnglish (US)
Pages (from-to)1381-1395
Number of pages15
JournalComputational Statistics and Data Analysis
Volume56
Issue number6
DOIs
StatePublished - Jun 1 2012
Externally publishedYes

Keywords

  • Eigenvalue decomposition
  • EM algorithm
  • Gaussian mixture model
  • Initialization
  • Truncated normal distribution

Fingerprint Dive into the research topics of 'Initializing the em algorithm in Gaussian mixture models with an unknown number of components'. Together they form a unique fingerprint.

Cite this