Markov Processes for Stochastic Modeling

ISBN-13: 9780323282956 / Angielski / Miękka / 2013 / 516 str.

Oliver Ibe

Opis

Markov processes are processes that have limited memory. In particular, their dependence on the past is only through the previous state. They are used to model the behavior of many systems including communications systems, transportation networks, image segmentation and analysis, biological systems and DNA sequence analysis, random atomic motion and diffusion in physics, social mobility, population studies, epidemiology, animal and insect migration, queueing systems, resource management, dams, financial engineering, actuarial science, and decision systems. Covering a wide range of areas of application of Markov processes, this second edition is revised to highlight the most important aspects as well as the most recent trends and applications of Markov processes. The author spent over 16 years in the industry before returning to academia, and he has applied many of the principles covered in this book in multiple research projects. Therefore, this is an applications-oriented book that also includes enough theory to provide a solid ground in the subject for the reader.

• Presents both the theory and applications of the different aspects of Markov processes
• Includes numerous solved examples as well as detailed diagrams that make it easier to understand the principle being presented
• Discusses different applications of hidden Markov models, such as DNA sequence analysis and speech analysis.

Recenzje

"Markov processes are the most popular modeling tools for stochastic systems in many different fields, and Ibe compiles in a single volume many of the Markovian models used indifferent disciplines. The information could be useful to graduate students and researchers in any field that uses Markov processes, he says, but he was thinking particularly of those in traffic engineering, image analysis, bioinformatics, biostatistics, financial engineering, and computational biology." --Reference and Research Book News, October 2013

Spis treści

Chapter 1: Basic ConceptsChapter 2: Introduction to Markov Processes Chapter 3: Discrete-Time Markov ChainsChapter 4: Continuous-Time Markov Chains Chapter 5: Markovian Queueing Systems Chapter 6: Markov Renewal ProcessesChapter 7: Markovian Arrival Processes Chapter 8: Random Walk Chapter 9: Brownian Motion and Diffusion Processes Chapter 10: Controlled Markov ProcessesChapter 11: Hidden Markov ModelsChapter 12: Markov Point Processes

O autorze

Dr Ibe has been teaching at U Mass since 2003. He also has more than 20 years of experience in the corporate world, most recently as Chief Technology Officer at Sineria Networks and Director of Network Architecture for Spike Broadband Corp.