Spectral Theory and Limit Theorems for Geometrically Ergodic Markov Processes

Consider the partial sums {St} of a real-valued functional F(Φ(t)) of a Markov chain {Φ(t)} with values in a general state space. Assuming only that the Markov chain is geometrically ergodic and that the functional F is bounded, the following conclusions are obtained: Spectral theory. Well-behaved s...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:The Annals of applied probability 2003, Vol.13 (1), p.304-362
Hauptverfasser: Kontoyiannis, I., Meyn, S. P.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Consider the partial sums {St} of a real-valued functional F(Φ(t)) of a Markov chain {Φ(t)} with values in a general state space. Assuming only that the Markov chain is geometrically ergodic and that the functional F is bounded, the following conclusions are obtained: Spectral theory. Well-behaved solutions f̌ can be constructed for the "multiplicative Poisson equation" (eα FP)f̌=λ f̌, where P is the transition kernel of the Markov chain and α ∈ C is a constant. The function f̌ is an eigenfunction, with corresponding eigenvalue λ, for the kernel (eα FP)=eα F(x)P(x,dy). A "multiplicative" mean ergodic theorem. For all complex α in a neighborhood of the origin, the normalized mean of exp (α St) (and not the logarithm of the mean) converges to f̌ exponentially fast, where f̌ is a solution of the multiplicative Poisson equation. Edgeworth expansions. Rates are obtained for the convergence of the distribution function of the normalized partial sums St to the standard Gaussian distribution. The first term in this expansion is of order (1/$\sqrt{t}$) and it depends on the initial condition of the Markov chain through the solution F̂ of the associated Poisson equation (and not the solution f̌ of the multiplicative Poisson equation). Large deviations. The partial sums are shown to satisfy a large deviations principle in a neighborhood of the mean. This result, proved under geometric ergodicity alone, cannot in general be extended to the whole real line. Exact large deviations asymptotics. Rates of convergence are obtained for the large deviations estimates above. The polynomial preexponent is of order (1/$\sqrt{t}$) and its coefficient depends on the initial condition of the Markov chain through the solution f̌ of the multiplicative Poisson equation. Extensions of these results to continuous-time Markov processes are also given.
ISSN:1050-5164
2168-8737
DOI:10.1214/aoap/1042765670