Hardware sizing, local deployment, and quantization.
GPU architectures, memory hierarchy, VRAM sizing, and compute bandwidth fundamentals.
3 Courses
Local inference engines (Ollama, llama.cpp), model weights management, and on-device runtime configuration.
3 Courses
Cluster compute topologies, high-speed interconnects (NVLink/InfiniBand), and multi-node systems.
4 Courses
Continuous batching, PagedAttention, KV cache management, speculative decoding, and vLLM deployment.
4 Courses
Production serving pipelines, containerized GPU runtimes, auto-scaling, and latency-throughput trade-offs.
4 Courses
ML compilers (torch.compile, TVM), graph capture, kernel fusion, and hardware code generation.
3 Courses
Automated training pipelines, model registries, artifact versioning, and continuous evaluation.
5 Courses
LLM observability, prompt tracing, latency and token cost telemetry, and automated evaluation.
4 Courses