Scientific article

A journey in single steps: robust one-step M-estimation in linear regression

Published inJournal of Statistical Planning and Inference, vol. 103, no. 1-2, p. 287-310
Publication date2002

We present a unified treatment of different types of one-step M-estimation in regression models which incorporates the Newton–Raphson, method of scoring and iteratively reweighted least squares forms of one-step estimator. We use higher order expansions to distinguish between the different forms of estimator and the effects of different initial estimators. We show that the Newton–Raphson form has better properties than the method of scoring form which, in turn, has better properties than the iteratively reweighted least squares form. We also show that the best choice of initial estimator is a smooth, robust estimator which converges at the rate n−1/2. These results have important consequences for the common data-analytic strategy of using a least squares analysis on “clean” data obtained by deleting observations with extreme residuals from an initial least squares fit. It is shown that the resulting estimator is an iteratively reweighted least squares one-step estimator with least squares as the initial estimator, giving it the worst performance of the one-step estimators we consider: inferences resulting from this strategy are neither valid nor robust.

  • Breakdown point
  • Diagnostics
  • Influence function
  • Iteratively reweighted least squares estimator
  • M-estimator
  • Method of scoring estimator
  • Newton–Raphson estimator
  • Outliers
  • Rejection method
  • S-estimator
Citation (ISO format)
WELSH, Alan H., RONCHETTI, Elvezio. A journey in single steps: robust one-step M-estimation in linear regression. In: Journal of Statistical Planning and Inference, 2002, vol. 103, n° 1-2, p. 287–310. doi: 10.1016/S0378-3758(01)00228-2

Technical informations

Creation10/01/2012 10:23:00 AM
First validation10/01/2012 10:23:00 AM
Update time03/14/2023 5:42:09 PM
Status update03/14/2023 5:42:09 PM
Last indexation05/02/2024 12:42:33 PM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack