Lesson 31: Markov Chains

We introduce Markov chains — a very beautiful and very useful kind of stochastic process — and discuss the Markov property, transition matrices, and stationary distributions.