Advanced GAN techniques
Chapter 1: GAN Foundations Revisited
The Generator-Discriminator Architecture
The Minimax Objective Function
Common Training Instabilities
Limitations of Vanilla GANs
Deep Convolutional GANs (DCGANs) Refresher
Chapter 2: Advanced GAN Architectures
Progressive Growing of GANs (ProGAN)
Style-Based Generator Architecture (StyleGAN)
StyleGAN2 Enhancements
Large Scale GAN Training (BigGAN)
Self-Attention Mechanisms in GANs
Unpaired Image-to-Image Translation (CycleGAN)
Implementing StyleGAN Components: Hands-on Practical
Chapter 3: GAN Training Dynamics and Stabilization
The Challenge of Non-Convergence
Mode Collapse: Causes and Consequences
Alternative Divergences: Wasserstein Distance
Weight Clipping in WGAN
Gradient Penalty (WGAN-GP)
Spectral Normalization
Two Time-Scale Update Rule (TTUR)
Relativistic GANs
Implementing WGAN-GP: Practice
Chapter 4: Conditional and Controllable Generation
Introduction to Conditional GANs (cGANs)
Architectures for cGANs
Information Maximizing GANs (InfoGAN)
StackGAN: Text-to-Image Synthesis
Controlling Attributes via Latent Space Manipulation
Disentanglement Metrics and Challenges
Building a Conditional GAN: Hands-on Practical
Chapter 5: Quantitative and Qualitative Evaluation of GANs
Challenges in Evaluating Generative Models
Qualitative Assessment: Visual Turing Tests
Inception Score (IS): Formulation and Limitations
Fréchet Inception Distance (FID): Formulation
Interpreting FID Scores
Precision and Recall for Distributions
Perceptual Path Length (PPL)
Calculating FID Score: Practice
Chapter 6: GANs Beyond Standard Image Generation
Challenges with Discrete Data: Text Generation
Reinforcement Learning Approaches (SeqGAN, RankGAN)
Continuous Approximations (Gumbel-Softmax)
Audio Synthesis with GANs (WaveGAN, SpecGAN)
Video Generation and Prediction
3D Data Generation (Point Clouds, Meshes)
Graph Generation with GANs
Chapter 7: Implementation, Optimization, and Tooling
Choosing Deep Learning Frameworks
Advanced Optimizers (AdamW, Lookahead)
Hyperparameter Tuning Strategies
Weight Initialization Techniques
Debugging Unstable GAN Training
Mixed Precision Training
Distributed Training Strategies for Large GANs
Profiling and Performance Optimization
Optimizing a GAN Implementation: Practice
Hyperparameter Tuning Strategies
Was this section helpful?
- Random Search for Hyper-Parameter Optimization, James Bergstra and Yoshua Bengio, 2012 Journal of Machine Learning Research, Vol. 13 (Microtome Publishing) DOI: 10.1622/jmlr.v13.12-140 - The original paper introducing random search as a more efficient alternative to grid search for hyperparameter optimization.
- GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium, Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter, 2017 Advances in Neural Information Processing Systems (NeurIPS) 30 (Curran Associates, Inc.) - Introduces the Two Time-Scale Update Rule (TTUR) for stable GAN training and the Fréchet Inception Distance (FID) for evaluating GAN sample quality.
- Population Based Training of Neural Networks, Max Jaderberg, Valentin Dalibard, Simon Osindero, Wojciech M. Czarnecki, Jeff Donahue, Ali Razavi, Oriol Vinyals, Tim Green, Iain Dunning, Karen Simonyan, Chrisantha Fernando, Koray Kavukcuoglu, 2017 arXiv preprint arXiv:1711.09846 DOI: 10.48550/arXiv.1711.09846 - Proposes Population-Based Training (PBT), a method that combines hyperparameter optimization and model training by concurrently training a population of models.
- Improved Training of Wasserstein GANs, Ishaan Gulrajani, Faruk Ahmed, Martin Arjovsky, Vincent Dumoulin, Aaron Courville, 2017 Advances in Neural Information Processing Systems, Vol. 30 (NeurIPS) DOI: 10.5555/3295222.3295327 - Introduces the WGAN-GP formulation, which uses a gradient penalty to enforce the Lipschitz constraint, significantly improving GAN training stability.
- Taking the human out of the loop: A review of Bayesian optimization, Babak Shahriari, Kevin Swersky, Ziyu Wang, Ryan P. Adams, and Nando de Freitas, 2016 Proceedings of the IEEE, Vol. 104 (IEEE) DOI: 10.1109/JPROC.2015.2494218 - A comprehensive review of Bayesian optimization, explaining its principles, components, and applications for optimizing expensive black-box functions.