This book provides an undergraduate introduction to discrete and continuous-time Markov chains and their applications. It includes more than 70 exercises, along with complete solutions, that help illustrate and present all concepts.