Automatic differentiation with torch.autograd, PyTorch Developers, 2025 (PyTorch Foundation) - Official tutorial explaining PyTorch's autograd engine, covering its core concepts and API.
Automatic Differentiation in Machine Learning: A Survey, Atılım Güneş Baydin, Barak A. Pearlmutter, and Jeffrey Mark Siskind, 2018Journal of Machine Learning Research, Vol. 18 (Microtome Publishing)DOI: 10.5555/3342930.3342931 - A comprehensive survey providing a mathematical and algorithmic overview of automatic differentiation techniques and their application in machine learning.
Deep Learning with PyTorch, Eli Stevens, Luca Antiga, and Thomas Viehmann, 2020 (Manning Publications) - A practical guide to deep learning using PyTorch, with detailed explanations of its automatic differentiation system and how it functions in real-world models.