Weak Convergence of the Regularization Path in Penalized M-Estimation
We consider a function defined as the point wise minimization of a doubly index random process. We are interested in the weak convergence of the minimizer in the space of bounded functions. Such convergence results can be applied in the context of penalized M-estimation, that is, when the random pro...
Gespeichert in:
Veröffentlicht in: | Scandinavian journal of statistics 2010-09, Vol.37 (3), p.477-495 |
---|---|
Hauptverfasser: | , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | We consider a function defined as the point wise minimization of a doubly index random process. We are interested in the weak convergence of the minimizer in the space of bounded functions. Such convergence results can be applied in the context of penalized M-estimation, that is, when the random process to minimize is expressed as a goodness-of-fit term plus a penalty term multiplied by a penalty weight. This weight is called the regularization parameter and the minimizing function the regularization path. The regularization path can be seen as a collection of estimators indexed by the regularization parameter. We obtain a consistency result and a central limit theorem for the regularization path in a functional sense. Various examples are provided, including the ℓ¹ -regularization path for general linear models, the ℓ¹ - or ℓ² -regularization path of the least absolute deviation regression and the Akaike information criterion. |
---|---|
ISSN: | 0303-6898 1467-9469 |
DOI: | 10.1111/j.1467-9469.2009.00682.x |