Getting Started with TensorFlow
Chapter 1: TensorFlow Fundamentals and Setup
Introduction to TensorFlow 2.x
Setting Up Your Development Environment
CPU vs GPU Considerations
Verifying Your Installation
The TensorFlow Ecosystem Overview
Quiz for Chapter 1
Chapter 2: Core TensorFlow Concepts
Understanding Tensors
Tensor Operations
Variables in TensorFlow
Automatic Differentiation with GradientTape
Introduction to tf.function
Practice: Tensor Manipulation and Gradients
Quiz for Chapter 2
Chapter 3: Building Models with Keras
Keras: TensorFlow's High-Level API
The Sequential Model API
Common Keras Layers
Activation Functions
The Functional API for Complex Models
Custom Layers and Models (Introduction)
Hands-on Practical: Building a Classifier
Quiz for Chapter 3
Chapter 4: Training and Evaluating Models
Compiling the Model: Loss Functions
Compiling the Model: Optimizers
Compiling the Model: Metrics
Training with model.fit()
Evaluating Model Performance with model.evaluate()
Making Predictions with model.predict()
Using Callbacks during Training
Visualizing Training with TensorBoard
Practice: Training and Monitoring
Quiz for Chapter 4
Chapter 5: Data Input Pipelines with tf.data
Why tf.data?
Creating Datasets from Tensors, NumPy, and Generators
Working with TFRecord Files
Applying Transformations: map()
Batching and Shuffling
Prefetching for Performance
Integrating tf.data with model.fit()
Image Data Augmentation with tf.data
Hands-on Practical: Building an Image Data Pipeline
Quiz for Chapter 5
Chapter 6: Saving and Loading Models
Why Save and Load Models?
Saving Checkpoints during Training
Saving Weights Only
Saving the Entire Model (Architecture + Weights + Optimizer State)
TensorFlow SavedModel Format
Loading Pre-trained Models
Introduction to TensorFlow Hub
Practice: Saving and Restoring Training
Quiz for Chapter 6
Activation Functions
Was this section helpful?
- Deep Learning, Ian Goodfellow, Yoshua Bengio, and Aaron Courville, 2016 (MIT Press) - This comprehensive book details neural network theory, covering the necessity of non-linearity and various activation functions like ReLU, sigmoid, and tanh, along with their properties.
- Deep Sparse Rectifier Networks, Xavier Glorot, Antoine Bordes, and Yoshua Bengio, 2011 Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics (AISTATS), Vol. 15 (Microtome Publishing) DOI: 10.55982/aistats.2011.27 - A seminal paper that introduced and evaluated the Rectified Linear Unit (ReLU) activation function, showing its advantages for training deep neural networks.
- Activations, Keras team, 2024 - Official Keras documentation providing details and usage examples for various activation functions available in the Keras API.