AMD Ryzen AI 9 HX 370 (64GB system, 48GB GPU-accessible)
The AMD Ryzen AI 9 HX 370 (64GB system, 48GB GPU-accessible) provides 48 GB of memory with 102 GB/s bandwidth, supporting local inference via ROCm and Vulkan acceleration.
Memory
48 GB
Usable Memory Ceiling
48 GB
Bandwidth
102.4 GB/s
Max Inference Class
32B Models (Q4)
TDP
54W
VRAM Usage vs Context Length
Simulated memory requirements as context increases. Curves crossing above the reference line will cause Out Of Memory (OOM) errors.
Precision:
Model Compatibility & Speed Matrix
Simulated inference throughput and memory feasibility across popular open-weights models.
Context:
KV Cache:
GPUs:
Need custom layer dimensions, offloading configurations, or distributed multi-node topology?
Open in Advanced VRAM CalculatorInference Feasibility
Maximum model parameter class runnable by weight precision.
Context:
4-bit
32B Models
8-bit
32B Models
16-bit
14B Models
Fine-Tuning Feasibility
Hardware capacity for local training and adapter fine-tuning.
Context Length:
QLoRA
32B Models
LoRA
14B Models
Full Parameter Training
7B-8B Models
Workload Recommendations
Guidance for optimal precision and operational ceilings on AMD Ryzen AI 9 HX 370 (64GB system, 48GB GPU-accessible).
Inference Sweet Spot
Optimized for 14B models at uncompressed or Q8 precision, and 32B models at Q4 with up to 32k context.
Bandwidth & Speed Profile
With 102.4 GB/s aggregate bandwidth, batch size 1 inference operates in a memory-bandwidth bound regime. Generates approximately 23 tok/s on an 8B Q4 model and 3 tok/s on a 70B Q4 model.