Finite Markov Chains and Algorithmic Applications

ISBN-13: 9780521890014 / Angielski / Miękka / 2002 / 126 str.

Olle Haggstrom; C. M. Series; J. W. Bruce

Opis

This text is ideal for advanced undergraduate or beginning graduate students. The author first develops the necessary background in probability theory and Markov chains before using it to study a range of randomized algorithms with important applications in optimization and other problems in computing. The book will appeal not only to mathematicians, but to students of computer science who will discover much useful material. This clear and concise introduction to the subject has numerous exercises that will help students to deepen their understanding.

Recenzje

'This elegant little book is a beautiful introduction to the theory of simulation algorithms, using (discrete) Markov chains (on finite state spaces) … highly recommended to anyone interested in the theory of Markov chain simulation algorithms.' Nieuw Archief voor Wiskunde

Spis treści

1. Basics of probability theory; 2. Markov chains; 3. Computer simulation of Markov chains; 4. Irreducible and aperiodic Markov chains; 5. Stationary distributions; 6. Reversible Markov chains; 7. Markov chain Monte Carlo; 8. Fast convergence of MCMC algorithms; 9. Approximate counting; 10. Propp-Wilson algorithm; 11. Sandwiching; 12. Propp-Wilson with read once randomness; 13. Simulated annealing; 14. Further reading.