Reinforcement Learning: An Introduction, Richard S. Sutton, Andrew G. Barto, 2018 (MIT Press) - This book details how dynamic programming forms the basis for solving optimal control problems in reinforcement learning.
Design and Analysis of Algorithms (6.046J), Erik Demaine, Srini Devadas, Nancy Lynch, 2015 (MIT OpenCourseWare) - An advanced algorithms course offering lecture videos and materials that cover dynamic programming in depth.