Getting Started with TensorFlow
Chapter 1: TensorFlow Fundamentals and Setup
Introduction to TensorFlow 2.x
Setting Up Your Development Environment
CPU vs GPU Considerations
Verifying Your Installation
The TensorFlow Ecosystem Overview
Quiz for Chapter 1
Chapter 2: Core TensorFlow Concepts
Understanding Tensors
Tensor Operations
Variables in TensorFlow
Automatic Differentiation with GradientTape
Introduction to tf.function
Practice: Tensor Manipulation and Gradients
Quiz for Chapter 2
Chapter 3: Building Models with Keras
Keras: TensorFlow's High-Level API
The Sequential Model API
Common Keras Layers
Activation Functions
The Functional API for Complex Models
Custom Layers and Models (Introduction)
Hands-on Practical: Building a Classifier
Quiz for Chapter 3
Chapter 4: Training and Evaluating Models
Compiling the Model: Loss Functions
Compiling the Model: Optimizers
Compiling the Model: Metrics
Training with model.fit()
Evaluating Model Performance with model.evaluate()
Making Predictions with model.predict()
Using Callbacks during Training
Visualizing Training with TensorBoard
Practice: Training and Monitoring
Quiz for Chapter 4
Chapter 5: Data Input Pipelines with tf.data
Why tf.data?
Creating Datasets from Tensors, NumPy, and Generators
Working with TFRecord Files
Applying Transformations: map()
Batching and Shuffling
Prefetching for Performance
Integrating tf.data with model.fit()
Image Data Augmentation with tf.data
Hands-on Practical: Building an Image Data Pipeline
Quiz for Chapter 5
Chapter 6: Saving and Loading Models
Why Save and Load Models?
Saving Checkpoints during Training
Saving Weights Only
Saving the Entire Model (Architecture + Weights + Optimizer State)
TensorFlow SavedModel Format
Loading Pre-trained Models
Introduction to TensorFlow Hub
Practice: Saving and Restoring Training
Quiz for Chapter 6
Compiling the Model: Optimizers
Was this section helpful?
- Deep Learning, Ian Goodfellow, Yoshua Bengio, Aaron Courville, 2016 (MIT Press) - A comprehensive resource on deep learning, with dedicated chapters discussing various optimization algorithms like gradient descent, SGD, momentum, Adam, and RMSprop.
- Adam: A Method for Stochastic Optimization, Diederik P. Kingma, Jimmy Ba, 2015 3rd International Conference for Learning Representations DOI: 10.48550/arXiv.1412.6980 - The original research paper introducing the Adam optimization algorithm, explaining its adaptive learning rate mechanism using first and second moments of gradients.
- tf.keras.optimizers module, TensorFlow Developers, 2024 - Official TensorFlow documentation for Keras optimizers, detailing their usage, parameters, and available algorithms such as SGD, Adam, and RMSprop for practical implementation.