ApX logoApX logo
ModelsCalculatorHardwareCoursesPricing
ApX logoApX logo
ModelsCalculatorHardwareCoursesPricing

All Courses

Getting Started with Local LLMs
Chapter 1: Introduction to Large Language Models
What Is a Large Language Model (LLM)?
A Simple View of How LLMs Work
Understanding Tokens and Text Generation
Why Run LLMs Locally?
Local vs. Cloud-Based LLMs
Quiz for Chapter 1
Chapter 2: Preparing Your Local Environment
Hardware Considerations: CPU
Hardware Considerations: RAM
Hardware Considerations: GPU and VRAM
Checking Your System Specifications
Operating System Compatibility
Installing Python (Optional but Recommended)
Introduction to the Command Line / Terminal
Quiz for Chapter 2
Chapter 3: Finding and Selecting Local LLMs
Where to Find LLM Models: Hugging Face Hub
Understanding Model Sizes and Parameters
Model Formats: GGUF and Others
Quantization: Making Models Smaller
Reading Model Cards for Information
Model Licenses and Usage Restrictions
Choosing Your First Model
Quiz for Chapter 3
Chapter 4: Running Your First Local LLM
Introduction to Local LLM Runners
Setting up Ollama
Downloading a Model with Ollama
Running a Model with Ollama (Command Line)
Setting up LM Studio
Finding and Downloading Models in LM Studio
Loading and Chatting with a Model in LM Studio
Introduction to llama.cpp (Concept)
Hands-on Practical: Running a Model
Quiz for Chapter 4
Chapter 5: Basic Interaction and Prompting
What is a Prompt?
Your First Prompt: Simple Questions
Giving Instructions
Understanding Context Window
Basic Prompt Formatting Tips
Temperature and Creativity
Common Interaction Patterns
Practice: Simple Prompting Techniques
Quiz for Chapter 5
Building a Customized Local AI Assistant

Getting Started with Local LLMs

Learn the fundamentals of running Large Language Models directly on your own computer. This course provides a step-by-step guide to setting up your environment, selecting models, and interacting with your first local LLM. Understand the concepts behind local LLMs without needing prior specialized knowledge.

Prerequisites Basic computer skills

Level:

Foundational

Certification Available:

Completion
  • Understand Local LLMs

    Explain what Large Language Models are and the advantages of running them locally.

  • Environment Setup

    Identify hardware considerations and set up the necessary software to run LLMs locally.

  • Model Selection

    Find and choose appropriate LLM models for local use based on size, performance, and licensing.

  • Basic Interaction

    Use common tools to load and interact with a local LLM for simple text generation tasks.

  • Fundamental Prompting

    Formulate basic prompts to guide text generation with a local LLM.

© 2026 ApX Machine Learning