Computable Bounds for Geometric Convergence Rates of Markov Chains

Recent results for geometrically ergodic Markov chains show that there exist constants $R < \infty, \rho < 1$ such that$\sup_{|f|\leq V}\big|\int P^n(x, dy)f(y) - \int \pi(dy)f(y)\big| \leq RV(x)\rho^n,$where π is the invariant probability measure and V is any solution of the drift inequalitie...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:The Annals of applied probability 1994-11, Vol.4 (4), p.981-1011
Hauptverfasser: Meyn, Sean P., Tweedie, R. L.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Recent results for geometrically ergodic Markov chains show that there exist constants $R < \infty, \rho < 1$ such that$\sup_{|f|\leq V}\big|\int P^n(x, dy)f(y) - \int \pi(dy)f(y)\big| \leq RV(x)\rho^n,$where π is the invariant probability measure and V is any solution of the drift inequalities ∫ P(x, dy)V(y) ≤ λ V(x) + b lC(x), which are known to guarantee geometric convergence for $\lambda < 1, b < \infty$ and a suitable small set C. In this paper we identify for the first time computable bounds on R and ρ in terms of λ, b and the minorizing constants which guarantee the smallness of C. In the simplest case where C is an atom α with P(α, α) ≥ δ we can choose any $\rho > \vartheta$, where [ 1 - ϑ]-1= 1/(1 - λ)2[ 1 - λ + b + b2+ ζα(b(1 - λ) + b2)] and ζα≤ (32 - 8 δ2/δ3) (b/1 - λ)2, and we can then choose R ≤ ρ/(ρ - ϑ). The bounds for general small sets C are similar but more complex. We apply these to simple queuing models and Markov chain Monte Carlo algorithms, although in the latter the bounds are clearly too large for practical application in the case considered.
ISSN:1050-5164
2168-8737
DOI:10.1214/aoap/1177004900