Markov chains and processes, random walks, stationary, independent increments, and Poisson processes. Ergodicity. Examples (e.g., diffusion, queuing theory, etc.).