UNIGE document Report
previous document  unige:17814  next document
add to browser collection

Robust VIF Regression

Dupuis, Debbie
Publication Montreal, CA, 2011
Collection Cahiers du GERAD
Abstract The sophisticated and automated means of data collection used by an increasing number of institutions and companies leads to extremely large datasets. Subset selection in regression is essential when a huge number of covariates can potentially explain a response variable of interest. The recent statistical literature has seen an emergence of new selection methods that provide some type of compromise between implementation (computational speed) and statistical optimality (e.g. prediction error minimization). Global methods such as Mallows’ Cp have been supplanted by sequential methods such as stepwise regression. More recently, streamwise regression, faster than the former, has emerged. A recently proposed streamwise regression approach based on the variance inflation factor (VIF) is promising but its least-squares based implementation makes it susceptible to the outliers inevitable in such large data sets. This lack of robustness can lead to poor and suboptimal feature selection. This article proposes a robust VIF regression, based on fast robust estimators, that inherits all the good properties of classical VIF in the absence of outliers, but also continues to perform well in their presence where the classical approach fails. The analysis of two real data sets shows the necessity of a robust approach for policy makers.
Keywords Variable selectionLinear regressionMulticollinearityM-estimator
Full text
Report (256 Kb) - public document Free access
(ISO format)
DUPUIS, Debbie, VICTORIA-FESER, Maria-Pia. Robust VIF Regression. 2011 https://archive-ouverte.unige.ch/unige:17814

562 hits



Deposited on : 2011-12-16

Export document
Format :
Citation style :