Penalized weighted least absolute deviation regression

Xiaoli Gao, Yang Feng

Research output: Contribution to journalArticlepeer-review

Abstract

In a linear model where the data is contaminated or the random error is heavy-tailed, least absolute deviation (LAD) regression has been widely used as an alternative approach to least squares (LS) regression. However, it is well known that LAD regression is not robust to outliers in the explanatory variables. When the data includes some leverage points, LAD regression may perform even worse than LS regression. In this manuscript, we propose to improve LAD regression in a penalized weighted least absolute deviation (PWLAD) framework. The main idea is to associate each observation with a weight reflecting the degree of outlying and leverage effect and obtain both the weight and coefficient vector estimation simultaneously and adaptively. The proposed PWLAD is able to provide regression coefficients estimate with strong robustness, and perform outlier detection at the same time, even when the random error does not have finite variances. We provide sufficient conditions under which PWLAD is able to identify true outliers consistently. The performance of the proposed estimator is demonstrated via extensive simulation studies and real examples.

Original languageEnglish (US)
Pages (from-to)79-89
Number of pages11
JournalStatistics and its Interface
Volume11
Issue number1
DOIs
StatePublished - 2018

Keywords

  • Lasso
  • Leverage points
  • Outlier detection
  • Robust regression
  • Weighted least absolute deviation

ASJC Scopus subject areas

  • Statistics and Probability
  • Applied Mathematics

Fingerprint

Dive into the research topics of 'Penalized weighted least absolute deviation regression'. Together they form a unique fingerprint.

Cite this