On the "degrees of freedom" of the lasso

Hui Zou, Trevor Hastie, Robert Tibshirani

Research output: Contribution to journalArticlepeer-review

474 Scopus citations

Abstract

We study the effective degrees of freedom of the lasso in the framework of Stein's unbiased risk estimation (SURE). We show that the number of nonzero coefficients is an unbiased estimate for the degrees of freedom of the lasso - a conclusion that requires no special assumption on the predictors. In addition, the unbiased estimator is shown to be asymptotically consistent. With these results on hand, various model selection criteria - Cp, AIC and BIC - are available, which, along with the LARS algorithm, provide a principled and efficient approach to obtaining the optimal lasso fit with the computational effort of a single ordinary least-squares fit.

Original languageEnglish (US)
Pages (from-to)2173-2192
Number of pages20
JournalAnnals of Statistics
Volume35
Issue number5
DOIs
StatePublished - Oct 1 2007

Keywords

  • Degrees of freedom
  • LARS algorithm
  • Lasso
  • Model selection
  • SURE
  • Unbiased estimate

Fingerprint Dive into the research topics of 'On the "degrees of freedom" of the lasso'. Together they form a unique fingerprint.

Cite this