Markov chains: irreducibility, periodicity, recurrence (section 1.5.1).
Markov chains: existence of and convergence to a unique stationary distribution (section 1.5.3)
Markov chains: Kac lemma (section 1.5.3)
Reference book: "Non equilibrium statistical physics: a modern perspective" by Livi and Politi