Scientific article
Open access

Stability of feature selection algorithms: a study on high-dimensional spaces

Published inKnowledge and Information Systems, vol. 12, no. 1, p. 95-116
  • Open Access - Licence nationale Springer
Publication date2007

With the proliferation of extremely high-dimensional data, feature selection algorithms have become indispensable components of the learning process. Strangely, despite extensive work on the stability of learning algorithms, the stability of feature selection algorithms has been relatively neglected. This study is an attempt to fill that gap by quantifying the sensitivity of feature selection algorithms to variations in the training set. We assess the stability of feature selection algorithms based on the stability of the feature preferences that they express in the form of weights-scores, ranks, or a selected feature subset. We examine a number of measures to quantify the stability of feature preferences and propose an empirical way to estimate them. We perform a series of experiments with several feature selection algorithms on a set of proteomics datasets. The experiments allow us to explore the merits of each stability measure and create stability profiles of the feature selection algorithms. Finally, we show how stability profiles can support the choice of a feature selection algorithm.

  • Machine learning
  • Feature selection
  • Stability
Citation (ISO format)
KALOUSIS, Alexandros, PRADOS, Julien, HILARIO, Mélanie. Stability of feature selection algorithms: a study on high-dimensional spaces. In: Knowledge and Information Systems, 2007, vol. 12, n° 1, p. 95–116. doi: 10.1007/s10115-006-0040-8
Main files (1)
Article (Published version)
ISSN of the journal0219-1377

Technical informations

Creation06/12/2018 1:49:00 PM
First validation06/12/2018 1:49:00 PM
Update time03/15/2023 8:19:49 AM
Status update03/15/2023 8:19:49 AM
Last indexation01/17/2024 3:01:08 AM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack