Markov Chains and Decision Processes for Engineers and Managers

ISBN-13: 9780367383435 / Angielski / Miękka / 2019 / 492 str.

Theodore J. Sheskin

Opis

This book presents an introduction to finite Markov chains and Markov decision processes, with applications in engineering and management. It introduces discrete-time, finite-state Markov chains, and Markov decision processes. The text describes both algorithms and applications, enabling students to understand the logical basis for the algorithms and be able to apply them. The applications address problems in government, business, and nonprofit sectors. The author uses Markov models to approximate the random behavior of complex systems in diverse areas, such as management, production, science, health services, finance, and marketing.

Spis treści

Markov Chain Structure and Models. Regular Markov Chains. Reducible Markov Chains. A Markov Chain with Rewards (MCR). A Markov Decision Process (MDP). Special Topics: State Reduction and Hidden Markov Chains. Index.

O autorze

Sheskin, Theodore J.