Scientific article
OA Policy
English

Density Estimation by Total Variation Penalized Likelihood Driven by the Sparsity ℓ1 Information Criterion

Published inScandinavian journal of statistics, vol. 37, no. 2, p. 321-337
Publication date2010
Abstract

We propose a non-linear density estimator, which is locally adaptive, like wavelet estimators, and positive everywhere, without a log- or root-transform. This estimator is based on maximizing a non-parametric log-likelihood function regularized by a total variation penalty. The smoothness is driven by a single penalty parameter, and to avoid cross-validation, we derive an information criterion based on the idea of universal penalty. The penalized log-likelihood maximization is reformulated as an ℓ1-penalized strictly convex programme whose unique solution is the density estimate. A Newton-type method cannot be applied to calculate the estimate because the ℓ1-penalty is non-differentiable. Instead, we use a dual block coordinate relaxation method that exploits the problem structure. By comparing with kernel, spline and taut string estimators on a Monte Carlo simulation, and by investigating the sensitivity to ties on two real data sets, we observe that the new estimator achieves good L1 and L2 risk for densities with sharp features, and behaves well with ties.

Citation (ISO format)
SARDY, Sylvain, TSENG, Paul. Density Estimation by Total Variation Penalized Likelihood Driven by the Sparsity ℓ1 Information Criterion. In: Scandinavian journal of statistics, 2010, vol. 37, n° 2, p. 321–337. doi: 10.1111/j.1467-9469.2009.00672.x
Main files (1)
Article (Accepted version)
accessLevelPublic
Identifiers
Journal ISSN0303-6898
743views
406downloads

Technical informations

Creation23/09/2010 14:48:00
First validation23/09/2010 14:48:00
Update time14/03/2023 16:06:40
Status update14/03/2023 16:06:39
Last indexation29/10/2024 17:09:21
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack