Weak Convergence of the Regularization Path in Penalized M-Estimation

We consider a function defined as the point wise minimization of a doubly index random process. We are interested in the weak convergence of the minimizer in the space of bounded functions. Such convergence results can be applied in the context of penalized M-estimation, that is, when the random pro...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Scandinavian journal of statistics 2010-09, Vol.37 (3), p.477-495
Hauptverfasser: GERMAIN, JEAN-FRANCOIS, ROUEFF, FRANCOIS
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:We consider a function defined as the point wise minimization of a doubly index random process. We are interested in the weak convergence of the minimizer in the space of bounded functions. Such convergence results can be applied in the context of penalized M-estimation, that is, when the random process to minimize is expressed as a goodness-of-fit term plus a penalty term multiplied by a penalty weight. This weight is called the regularization parameter and the minimizing function the regularization path. The regularization path can be seen as a collection of estimators indexed by the regularization parameter. We obtain a consistency result and a central limit theorem for the regularization path in a functional sense. Various examples are provided, including the ℓ¹ -regularization path for general linear models, the ℓ¹ - or ℓ² -regularization path of the least absolute deviation regression and the Akaike information criterion.
ISSN:0303-6898
1467-9469
DOI:10.1111/j.1467-9469.2009.00682.x