Siegfried Wichmann Onesimo Hernandez-Lerma Jean Bernard Lasserre
This book concerns discrete-time homogeneous Markov chains that admit an invariant probability measure. The main objective is to give a systematic, self-contained presentation on some key issues about the ergodic behavior of that class of Markov chains. These issues include, in particular, the various types of convergence of expected and pathwise occupation measures, and ergodic decompositions of the state space.
This book concerns discrete-time homogeneous Markov chains that admit an invariant probability measure. The main objective is to give a systematic,...