Reinforcement Learning: An Introduction, Richard S. Sutton and Andrew G. Barto, 2018 (MIT Press) - A fundamental textbook offering a comprehensive introduction to reinforcement learning, with a dedicated chapter on finite Markov Decision Processes.
Markov Decision Processes (CS234 Lecture 2 Notes), Emma Brunskill, 2023 (Stanford University) - Lecture notes from a prominent Stanford University course on Reinforcement Learning, providing a concise overview of MDP components and concepts.