Metastability of exponentially perturbed Markov chains
A family of irreducible Markov chains on a finite state space is considered as an exponential perturbation of a reducible Markov chain. This is a generalization of the Freidlin-Wentzell theory, motivated by studies of stochastic Ising models, neural network and simulated annealing. It is shown that...
Gespeichert in:
Veröffentlicht in: | 中国科学:数学英文版 1996 (1), p.7-28 |
---|---|
1. Verfasser: | |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | A family of irreducible Markov chains on a finite state space is considered as an exponential perturbation of a reducible Markov chain. This is a generalization of the Freidlin-Wentzell theory, motivated by studies of stochastic Ising models, neural network and simulated annealing. It is shown that the metastability is a universal feature for this wide class of Markov chains. The metastable states are simply those recurrent states of the reducible Markov chain. Higher level attractors, related attractive basins and their pyramidal structure are analysed. The logarithmic asymptotics of the hitting time of various sets are estimated. The hitting time over its mean converges in law to the unit exponential distribution. |
---|---|
ISSN: | 1674-7283 1869-1862 |