Regularized parameter estimation in high-dimensional gaussian mixture models

Lingyan Ruan, Ming Yuan, Hui Zou

Research output: Contribution to journalLetterpeer-review

15 Scopus citations

Abstract

Finite gaussian mixture models are widely used in statistics thanks to their great flexibility. However, parameter estimation for gaussian mixture models with high dimensionality can be challenging because of the large number of parameters that need to be estimated. In this letter, we propose a penalized likelihood estimator to address this difficulty. The l1-type penalty we impose on the inverse covariance matrices encourages sparsity on its entries and therefore helps to reduce the effective dimensionality of the problem. We show that the proposed estimate can be efficiently computed using an expectation-maximization algorithm. To illustrate the practical merits of the proposed method, we consider its applications in model-based clustering and mixture discriminant analysis. Numerical experiments with both simulated and real data show that the new method is a valuable tool for high-dimensional data analysis.

Original languageEnglish (US)
Pages (from-to)1605-1622
Number of pages18
JournalNeural computation
Volume23
Issue number6
DOIs
StatePublished - Jun 2011

Fingerprint Dive into the research topics of 'Regularized parameter estimation in high-dimensional gaussian mixture models'. Together they form a unique fingerprint.

Cite this