This book provides a rigorous but elementary introduction to the theory of Markov Processes on a countable state space. It should be accessible to students with

Markov process theory provides a mathematical framework for analyzing the elements of randomness that are involved in most real-world dynamical processes. This

Markov processes are processes that have limited memory. In particular, their dependence on the past is only through the previous state. They are used to model

From the reviews of the First Edition: "This excellent book is based on several sets of lecture notes written over a decade and has its origin in a one-semester

Markov processes are among the most important stochastic processes for both theory and applications. This book develops the general theory of these processes, a