Doctoral thesis
Open access

Confidence sets for model selection

ContributorsHannay, Mark
Defense date2016-08-15

At first glance the goals of model selection might seem clear. Out of a set of possible models, we want to select the ”best” or a subset of ”best” models. This notion of ”best” however is not well defined, since it obviously depends on the initial goals of the selection. In order to study the uncertainty in model selection, we introduce a new definition of a model, where the models are no longer defined through zero and non-zero components but through irrelevant and relevant component. Then inspired by confidence intervals for estimated parameters, we propose a method to build confidence sets for model selection in a parametric setting, i.e. create sets of models within which the true model is included with a certain confidence. This allows us to perform inference on model selection. We discuss the computational challenges with such a method, how to find p-values (for the model), consistency in model selection and through a data set and a simulation study show the implications of this new method.

  • Model selection
  • Confidence set
  • Uncertainty in model selection
  • Relevance and irrelevance testing
Citation (ISO format)
HANNAY, Mark. Confidence sets for model selection. 2016. doi: 10.13097/archive-ouverte/unige:86467
Main files (1)

Technical informations

Creation08/15/2016 2:52:00 PM
First validation08/15/2016 2:52:00 PM
Update time03/15/2023 12:40:47 AM
Status update03/15/2023 12:40:46 AM
Last indexation05/02/2024 5:42:31 PM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack