Convex Optimization, Stephen Boyd, Lieven Vandenberghe, 2004 (Cambridge University Press) - Foundational textbook providing a comprehensive treatment of convex sets, convex functions, and their role in optimization, essential for understanding machine learning algorithms.
Deep Learning, Ian Goodfellow, Yoshua Bengio, Aaron Courville, 2016 (MIT Press) - Although focused on deep learning, Chapter 4 and 5 provide foundational concepts on optimization, including the benefits of convexity for traditional machine learning models and the challenges of non-convexity in deep learning.
Numerical Optimization, Jorge Nocedal, Stephen J. Wright, 2006 (Springer)DOI: 10.1007/978-0-387-40065-5 - A standard reference for numerical optimization methods, including detailed discussions on convex analysis, optimality conditions, and algorithms, highly relevant for advanced understanding.
EE364A: Convex Optimization I (Course Materials), Stephen Boyd, 2023 (Stanford University) - Comprehensive course materials, including lecture notes and assignments, that provide a structured academic approach to convex optimization, directly covering the concepts discussed in the section.