A Note on Cross-Validation for Lasso Under Measurement Errors

Abhirup Datta, Hui Zou

Research output: Contribution to journalComment/debatepeer-review

Abstract

Variants of the Lasso or (Formula presented.) -penalized regression have been proposed to accommodate for presence of measurement errors in the covariates. Theoretical guarantees of these estimates have been established for some oracle values of the regularization parameters which are not known in practice. Data-driven tuning such as cross-validation has not been studied when covariates contain measurement errors. We demonstrate that in the presence of error-in-covariates, even when using a Lasso-variant that adjusts for measurement error, application of naive leave-one-out cross-validation to select the tuning parameter can be problematic. We provide an example where such a practice leads to estimation inconsistency. We also prove that a simple correction to cross-validation procedure restores consistency. We also study the risk consistency of the two cross-validation procedures and offer guideline on the choice of cross-validation based on the measurement error distributions of the training and the prediction data. The theoretical findings are validated using simulated data. Supplementary materials for this article are available online.

Original languageEnglish (US)
Pages (from-to)549-556
Number of pages8
JournalTechnometrics
Volume62
Issue number4
DOIs
StatePublished - Oct 1 2020

Bibliographical note

Funding Information:
Zou?s research is supported in part by NSF grant DMS-1915842. We thank the editor, the associate editor, and the anonymous reviewers for their helpful feedback which helped to greatly improve the article. We thank Dr. Po-Ling Loh for sharing R and Matlab codes for computing the NCL estimator.

Keywords

  • Cross-validation
  • Inconsistency
  • Lasso
  • Measurement errors

Fingerprint Dive into the research topics of 'A Note on Cross-Validation for Lasso Under Measurement Errors'. Together they form a unique fingerprint.

Cite this