Introduction to information theory: Kullback-Leibler divergence, Shannon entropy of correlated random variables (section 1.2)

Reference book: "Information, physics, and computation" by Mezard and Montanari