What to Save in Checkpoints