Maximum likelihood fitting using ordinary least squares algorithms

Rasmus Bro, Nicholaos D. Sidiropoulos, Age K. Smilde

Research output: Contribution to journalArticle

80 Scopus citations

Abstract

In this paper a general algorithm is provided for maximum likelihood fitting of deterministic models subject to Gaussian-distributed residual variation (including any type of non-singular covariance). By deterministic models is meant models in which no distributional assumptions are valid (or applied) on the parameters. The algorithm may also more generally be used for weighted least squares (WLS) fitting in situations where either distributional assumptions are not available or other than statistical assumptions guide the choice of loss function. The algorithm to solve the associated problem is called MILES (Maximum likelihood via Iterative Least squares EStimation). It is shown that the sought parameters can be estimated using simple least squares (LS) algorithms in an iterative fashion. The algorithm is based on iterative majorization and extends earlier work for WLS fitting of models with heteroscedastic uncorrelated residual variation. The algorithm is shown to include several current algorithms as special cases. For example, maximum likelihood principal component analysis models with and without offsets can be easily fitted with MILES. The MILES algorithm is simple and can be implemented as an outer loop in any least squares algorithm, e.g. for analysis of variance, regression, response surface modeling, etc. Several examples are provided on the use of MILES.

Original languageEnglish (US)
Pages (from-to)387-400
Number of pages14
JournalJournal of Chemometrics
Volume16
Issue number8-10
DOIs
StatePublished - Aug 1 2002

Keywords

  • Iterative majorization
  • Measurement error
  • PARAFAC
  • PCA
  • Weighted least squares

Fingerprint Dive into the research topics of 'Maximum likelihood fitting using ordinary least squares algorithms'. Together they form a unique fingerprint.

  • Cite this