Applied Data Science: Techniques and Implementation
Chapter 1: Advanced Data Acquisition and Preparation
Connecting to Databases and Data Warehouses
Working with Web APIs for Data Retrieval
Techniques for Web Scraping Structured Data
Advanced Data Cleaning Methods
Strategies for Handling Missing Values
Data Transformation and Normalization Techniques
Merging and Joining Diverse Datasets
Hands-on: Data Acquisition and Wrangling Practice
Quiz for Chapter 1
Chapter 2: Practical Feature Engineering
Generating Features from Numerical Data
Encoding Categorical Variables Effectively
Creating Features from Text Data
Interaction Terms and Polynomial Features
Dimensionality Reduction with PCA
Selecting Features using Statistical Methods
Hands-on: Feature Creation and Selection
Quiz for Chapter 2
Chapter 3: Building and Tuning Predictive Models
Review of Common Supervised Learning Algorithms
Implementing Linear and Logistic Regression
Applying Tree-Based Models
Introduction to Gradient Boosting Machines
Hyperparameter Tuning using Grid Search and Randomized Search
Model Evaluation of Accuracy
Cross-Validation Strategies
Hands-on: Model Training and Hyperparameter Optimization
Quiz for Chapter 3
Chapter 4: Applied Unsupervised Learning
Understanding Clustering Concepts
Implementing K-Means Clustering
Applying DBSCAN for Density-Based Clustering
Introduction to Anomaly Detection Methods
Dimensionality Reduction for Visualization
Hands-on: Clustering and Anomaly Detection Practice
Quiz for Chapter 4
Chapter 5: Model Deployment Fundamentals
Saving and Loading Trained Models
Introduction to Model Serving Frameworks
Building a REST API for Model Prediction
Containerizing Applications with Docker
Basic Model Monitoring Concepts
Hands-on: Creating and Containerizing a Model API
Quiz for Chapter 5
Introduction to Gradient Boosting Machines
Was this section helpful?
- Greedy Function Approximation: A Gradient Boosting Machine, Jerome H. Friedman, 2001 The Annals of Statistics, Vol. 29 (Institute of Mathematical Statistics) DOI: 10.1214/aos/1013203451 - The seminal paper introducing the Gradient Boosting Machine, detailing its theoretical framework and algorithms.
- The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Trevor Hastie, Robert Tibshirani, and Jerome Friedman, 2009 (Springer) - A standard textbook providing a comprehensive statistical and algorithmic treatment of ensemble methods, including detailed sections on boosting and gradient boosting.
- XGBoost: A Scalable Tree Boosting System, Tianqi Chen, Carlos Guestrin, 2016 Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (ACM) DOI: 10.1145/2939672.2939785 - Introduces XGBoost, an optimized gradient boosting library, highlighting its enhancements for speed, regularization, and parallel computing.
- LightGBM: A Highly Efficient Gradient Boosting Decision Tree, Guolin Ke, Qi Meng, Thomas Finley, Taifeng Wang, Wei Chen, Weidong Ma, Qiwei Ye, and Tie-Yan Liu, 2017 Advances in Neural Information Processing Systems, Vol. 30 (Curran Associates, Inc.) - Presents LightGBM, focusing on its histogram-based decision tree learning and exclusive feature bundling for faster training and better accuracy.