Efficient global approximation of generalized nonlinear ℓ1 -Regularized solution paths and its applications

Ming Yuan, Hui Zou

Research output: Contribution to journalArticle

7 Scopus citations

Abstract

We consider efficient construction of nonlinear solution paths for general ℓ1-regularization. Unlike the existing methods that incrementally build the solution path through a combination of local linear approximation and recalibration, we propose an efficient global approximation to the whole solution path. With the loss function approximated by a quadratic spline, we show that the solution path can be computed using a generalized Lars algorithm. The proposed methodology avoids high-dimensional numerical optimization and thus provides faster and more stable computation. The methodology also can be easily extended to more general regularization framework. We illustrate such flexibility with several examples, including a generalization of the elastic net and a new method that effectively exploits the so-called "support vectors" in kernel logistic regression.

Original languageEnglish (US)
Pages (from-to)1562-1574
Number of pages13
JournalJournal of the American Statistical Association
Volume104
Issue number488
DOIs
StatePublished - Dec 1 2009

Keywords

  • LARS
  • LASSO
  • Solution path
  • Support vector pursuit
  • ℓ-regularization

Fingerprint Dive into the research topics of 'Efficient global approximation of generalized nonlinear ℓ<sub>1</sub> -Regularized solution paths and its applications'. Together they form a unique fingerprint.

  • Cite this