Cocolasso for high-dimensional error-in-variables regression

Abhirup Datta, Hui Zou

Research output: Contribution to journalArticle

17 Scopus citations

Abstract

Much theoretical and applied work has been devoted to high-dimensional regression with clean data. However, we often face corrupted data in many applications where missing data and measurement errors cannot be ignored. Loh and Wainwright [Ann. Statist. 40 (2012) 1637–1664] proposed a nonconvex modification of the Lasso for doing high-dimensional regression with noisy and missing data. It is generally agreed that the virtues of convexity contribute fundamentally the success and popularity of the Lasso. In light of this, we propose a new method named CoCoLasso that is convex and can handle a general class of corrupted datasets. We establish the estimation error bounds of CoCoLasso and its asymptotic sign-consistent selection property. We further elucidate how the standard cross validation techniques can be misleading in presence of measurement error and develop a novel calibrated cross-validation technique by using the basic idea in CoCoLasso. The calibrated cross-validation has its own importance. We demonstrate the superior performance of our method over the nonconvex approach by simulation studies.

Original languageEnglish (US)
Pages (from-to)2400-2426
Number of pages27
JournalAnnals of Statistics
Volume45
Issue number6
DOIs
StatePublished - Dec 2017

    Fingerprint

Keywords

  • Convex optimization
  • Error in variables
  • High-dimensional regression
  • LASSO
  • Missing data

Cite this