UNIGE document Scientific Article
previous document  unige:23228  next document
add to browser collection

A journey in single steps: robust one-step M-estimation in linear regression

Welsh, Alan H.
Published in Journal of Statistical Planning and Inference. 2002, vol. 103, no. 1-2, p. 287-310
Abstract We present a unified treatment of different types of one-step M-estimation in regression models which incorporates the Newton–Raphson, method of scoring and iteratively reweighted least squares forms of one-step estimator. We use higher order expansions to distinguish between the different forms of estimator and the effects of different initial estimators. We show that the Newton–Raphson form has better properties than the method of scoring form which, in turn, has better properties than the iteratively reweighted least squares form. We also show that the best choice of initial estimator is a smooth, robust estimator which converges at the rate n−1/2. These results have important consequences for the common data-analytic strategy of using a least squares analysis on “clean” data obtained by deleting observations with extreme residuals from an initial least squares fit. It is shown that the resulting estimator is an iteratively reweighted least squares one-step estimator with least squares as the initial estimator, giving it the worst performance of the one-step estimators we consider: inferences resulting from this strategy are neither valid nor robust.
Keywords Breakdown pointDiagnosticsInfluence functionIteratively reweighted least squares estimatorM-estimatorMethod of scoring estimatorNewton–Raphson estimatorOutliersRejection methodS-estimator
Full text
(ISO format)
WELSH, Alan H., RONCHETTI, Elvezio. A journey in single steps: robust one-step M-estimation in linear regression. In: Journal of Statistical Planning and Inference, 2002, vol. 103, n° 1-2, p. 287-310. https://archive-ouverte.unige.ch/unige:23228

386 hits

0 download


Deposited on : 2012-10-06

Export document
Format :
Citation style :