Criterion Mixing Lack of Fit and Multicolinearity for Variable Selection in Regression

ContributorsRolle, Jean-Daniel
  • Cahiers de recherche; 1999.11
Publication date1999

We describe in this paper a method allowing to order submodels in linear regression. A real function is attached to each submodel, allowing to graphically compare and order them. Our procedure defines an objective function depending on two factors (lack of fit and multicolinearity) with the property that the minimum of this function over subsets of the regressors determines the "best" such subset of variables. The latter will be found by systematically examining all possible subsets having at least two regressors. The method is built in such a way that it allows a graphical inspection of the submodels. Although it is presented here only in the framework of linear regression with a single, continuous, response variable, the procedure may be extended in a natural way to more general regression models. Simulation and implementation on various data sets gave very satisfying results

Citation (ISO format)
ROLLE, Jean-Daniel. Criterion Mixing Lack of Fit and Multicolinearity for Variable Selection in Regression. 1999
  • PID : unige:5873

Technical informations

Creation04/15/2010 12:20:54 PM
First validation04/15/2010 12:20:54 PM
Update time03/14/2023 3:26:56 PM
Status update03/14/2023 3:26:56 PM
Last indexation01/15/2024 7:45:14 PM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack