Limitations of Dynamic Programming in RL