Chapter 4: 4.4, 4.5, 4.6 (Additional question: When is this Markov chain reversible?), 4.8, 4.13.
Chapter 10: 10.1, 10.2, 10.3, 10.4, 10.5.