Optuna Documentation, Optuna Developers, 2024 - A comprehensive guide for using Optuna, detailing its API, samplers, pruning, and visualization features.
Hyperopt Documentation, Hyperopt Developers, 2024 - Provides detailed information on Hyperopt's search space definition, optimization algorithms (TPE), and fmin function.
Optuna: A Next-generation Hyperparameter Optimization Framework, Takuya Akiba, Shotaro Sano, Toshihiko Yanase, Takeru Ohta, Masanori Koyama, 2019Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD '19) (Association for Computing Machinery)DOI: 10.1145/3292500.3330705 - Introduces Optuna's design principles, including its define-by-run API, dynamic search space, and pruning capabilities.
Algorithms for Hyper-Parameter Optimization, James Bergstra, Rémi Bardenet, Yoshua Bengio, Balázs Kégl, 2013Journal of Machine Learning Research (JMLR), Vol. 13 - Describes the Tree-structured Parzen Estimator (TPE) algorithm, which is a component of Bayesian optimization used in Hyperopt.