Probability and Random Processes begins with the basic ideas common to most undergraduate courses in mathematics, statistics, and science. It ends with material usually found at graduate level, for example, Markov processes, (including Markov chain Monte Carlo), martingales, queues, diffusions, (including stochastic calculus with Itô's formula), renewals, stationary processes (including the ergodic theorem), and option pricing in mathematical finance
using the Black-Scholes formula. Further, in this new revised fourth edition, there are sections on coupling from the past, Lévy processes,...