Introduction to Machine Learning
Chapter 1: What is Machine Learning?
Defining Machine Learning
Why Learn Machine Learning?
Examples of ML in Everyday Life
Distinguishing ML from Traditional Programming
Types of Machine Learning Systems
The Machine Learning Workflow Overview
Tools You Might Use
Quiz for Chapter 1
Chapter 2: Fundamental Concepts
Data: The Fuel for Machine Learning
Features and Labels Explained
Training, Validation, and Test Sets
Models: Learning from Data
Parameters and Hyperparameters
Introduction to Overfitting and Underfitting
Measuring Performance: Basic Metrics
Quiz for Chapter 2
Chapter 3: Supervised Learning: Regression
Understanding Regression Problems
Introduction to Linear Regression
How Linear Regression Learns
Cost Functions: Measuring Error
Gradient Descent: Finding the Best Fit
Simple Linear Regression Example
Practice: Implementing Simple Linear Regression
Quiz for Chapter 3
Chapter 4: Supervised Learning: Classification
Understanding Classification Problems
Introduction to Logistic Regression
The Sigmoid Function
Decision Boundaries
Introduction to K-Nearest Neighbors (KNN)
How KNN Works
Evaluating Classification Models
Practice: Implementing KNN for Classification
Quiz for Chapter 4
Chapter 5: Unsupervised Learning: Clustering
What is Unsupervised Learning?
Introduction to Clustering
The K-Means Algorithm
Choosing the Number of Clusters (K)
How K-Means Finds Clusters
Limitations of K-Means
Practice: Applying K-Means to Simple Data
Quiz for Chapter 5
Chapter 6: Preparing Your Data
The Importance of Data Preprocessing
Handling Missing Values
Introduction to Feature Scaling
Encoding Categorical Features
Splitting Data into Training and Testing Sets Revisited
Hands-on Practical: Basic Data Cleaning Steps
Quiz for Chapter 6
Chapter 7: Building Your First Machine Learning Model
Recap: The ML Workflow Steps
Choosing the Right Algorithm
Loading and Preparing Data with a Library
Training a Simple Model
Making Predictions
Evaluating Model Performance
Hands-on Practical: End-to-End Simple Model Building
Quiz for Chapter 7
How KNN Works
Was this section helpful?
- The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Trevor Hastie, Robert Tibshirani, and Jerome Friedman, 2009 (Springer) - A comprehensive textbook covering various machine learning algorithms, including a detailed explanation of K-Nearest Neighbors, its theoretical basis, and practical aspects.
- Nearest neighbor pattern classification, Thomas Cover and Peter Hart, 1967 IEEE Transactions on Information Theory, Vol. 13 (IEEE) DOI: 10.1109/TIT.1967.1053964 - The seminal paper that introduced and formalized the K-Nearest Neighbors algorithm, providing its theoretical foundations.
- Pattern Recognition and Machine Learning, Christopher M. Bishop, 2006 (Springer) - A widely-used textbook offering a thorough treatment of pattern recognition and machine learning concepts, including a dedicated section on the K-Nearest Neighbors algorithm.
- CS229 Lecture Notes: Supervised Learning (K-Nearest Neighbors section), Stanford CS229 Course Staff, 2018 (Stanford University) - Lecture notes from Stanford University's machine learning course providing a clear introduction to K-Nearest Neighbors within the context of supervised learning.