Filters
Architecture
Minimum Usable Memory
Any
Calculator
Simulate exact memory requirements, batch size, and concurrency for any setup.
Test in CalculatorLLM Hardware Directory
Local LLM Performance, Memory Limits & Compatibility
131 Hardware Configurations
| Hardware Specifications | Type | Memory | Bandwidth | TDP | Max Model Class | |
|---|---|---|---|---|---|---|
| AMD RX 6600 (8GB) | Discrete | 8 GB | 224 GB/s | 132W | 8B | |
| AMD RX 6600 XT (8GB) | Discrete | 8 GB | 256 GB/s | 160W | 8B | |
| AMD RX 6650 XT (8GB) | Discrete | 8 GB | 280 GB/s | 180W | 8B | |
| AMD RX 6700 (10GB) | Discrete | 10 GB | 320 GB/s | 175W | 8B | |
| AMD RX 6700 XT (12GB) | Discrete | 12 GB | 384 GB/s | 230W | 14B | |
| AMD RX 6750 XT (12GB) | Discrete | 12 GB | 432 GB/s | 250W | 14B | |
| AMD RX 6800 (16GB) | Discrete | 16 GB | 512 GB/s | 250W | 14B | |
| AMD RX 6800 XT (16GB) | Discrete | 16 GB | 512 GB/s | 300W | 14B | |
| AMD RX 6900 XT (16GB) | Discrete | 16 GB | 512 GB/s | 300W | 14B | |
| AMD RX 6950 XT (16GB) | Discrete | 16 GB | 576 GB/s | 335W | 14B | |
| AMD RX 7600 (8GB) | Discrete | 8 GB | 288 GB/s | 165W | 8B | |
| AMD RX 7600 XT (16GB) | Discrete | 16 GB | 288 GB/s | 190W | 14B | |
| AMD RX 7700 XT (12GB) | Discrete | 12 GB | 432 GB/s | 245W | 14B | |
| AMD RX 7800 XT (16GB) | Discrete | 16 GB | 624 GB/s | 263W | 14B | |
| AMD RX 7900 GRE (16GB) | Discrete | 16 GB | 576 GB/s | 260W | 14B | |
| AMD RX 7900 XT (20GB) | Discrete | 20 GB | 800 GB/s | 315W | 32B | |
| AMD RX 7900 XTX (24GB) | Discrete | 24 GB | 960 GB/s | 355W | 32B | |
| AMD RX 9070 (16GB) | Discrete | 16 GB | 640 GB/s | 220W | 14B | |
| AMD RX 9070 XT (16GB) | Discrete | 16 GB | 640 GB/s | 304W | 14B | |
| AMD Ryzen AI 9 HX 370 (32GB system, 24GB GPU-accessible) | Discrete | 24 GB | 89.6 GB/s | 54W | 32B | |
| AMD Ryzen AI 9 HX 370 (64GB system, 48GB GPU-accessible) | Discrete | 48 GB | 102.4 GB/s | 54W | 32B | |
| AMD Ryzen AI 9 HX 370 (96GB system, 72GB GPU-accessible) | Discrete | 72 GB | 128 GB/s | 54W | 70B+ | |
| AMD Ryzen AI MAX+ 395 (128GB system, 96GB GPU-accessible) | Discrete | 96 GB | 256 GB/s | 120W | 70B+ | |
| Apple M2 Max (32GB) | Unified | 32 GB 24 GB usable | 400 GB/s | 100W | 32B | |
| Apple M2 Max (64GB) | Unified | 64 GB 48 GB usable | 400 GB/s | 100W | 32B | |
| Apple M2 Max (96GB) | Unified | 96 GB 72 GB usable | 400 GB/s | 100W | 70B+ | |
| Apple M2 Pro (16GB) | Unified | 16 GB 12 GB usable | 200 GB/s | 67W | 14B | |
| Apple M2 Ultra (128GB) | Unified | 128 GB 96 GB usable | 800 GB/s | 230W | 70B+ | |
| Apple M2 Ultra (192GB) | Unified | 192 GB 144 GB usable | 800 GB/s | 230W | 70B+ | |
| Apple M2 Ultra (64GB) | Unified | 64 GB 48 GB usable | 800 GB/s | 230W | 32B | |
| Apple M3 Max (128GB) | Unified | 128 GB 96 GB usable | 400 GB/s | 115W | 70B+ | |
| Apple M3 Max (36GB) | Unified | 36 GB 27 GB usable | 300 GB/s | 115W | 32B | |
| Apple M3 Max (48GB) | Unified | 48 GB 36 GB usable | 400 GB/s | 115W | 32B | |
| Apple M3 Max (64GB) | Unified | 64 GB 48 GB usable | 400 GB/s | 115W | 32B | |
| Apple M3 Max (96GB) | Unified | 96 GB 72 GB usable | 400 GB/s | 115W | 70B+ | |
| Apple M3 Pro (18GB) | Unified | 18 GB 13.5 GB usable | 150 GB/s | 75W | 14B | |
| Apple M3 Pro (36GB) | Unified | 36 GB 27 GB usable | 150 GB/s | 75W | 32B | |
| Apple M3 Ultra (256GB) | Unified | 256 GB 192 GB usable | 819.2 GB/s | 250W | 70B+ | |
| Apple M3 Ultra (512GB) | Unified | 512 GB 384 GB usable | 819.2 GB/s | 250W | 70B+ | |
| Apple M4 (16GB) | Unified | 16 GB 12 GB usable | 120 GB/s | 45W | 14B | |
| Apple M4 (24GB) | Unified | 24 GB 18 GB usable | 120 GB/s | 45W | 14B | |
| Apple M4 (32GB) | Unified | 32 GB 24 GB usable | 120 GB/s | 45W | 32B | |
| Apple M4 Max (128GB) | Unified | 128 GB 96 GB usable | 546 GB/s | 140W | 70B+ | |
| Apple M4 Max (64GB) | Unified | 64 GB 48 GB usable | 546 GB/s | 140W | 32B | |
| Apple M4 Max (96GB) | Unified | 96 GB 72 GB usable | 546 GB/s | 140W | 70B+ | |
| Apple M4 Pro (32GB) | Unified | 32 GB 24 GB usable | 273 GB/s | 85W | 32B | |
| Apple M4 Pro (48GB) | Unified | 48 GB 36 GB usable | 273 GB/s | 85W | 32B | |
| Apple M4 Pro (64GB) | Unified | 64 GB 48 GB usable | 273 GB/s | 85W | 32B | |
| Apple M5 (16GB) | Unified | 16 GB 12 GB usable | 153 GB/s | 50W | 14B | |
| Apple M5 (24GB) | Unified | 24 GB 18 GB usable | 153 GB/s | 50W | 14B | |
| Apple M5 (32GB) | Unified | 32 GB 24 GB usable | 153 GB/s | 50W | 32B | |
| Apple M5 Max (128GB) | Unified | 128 GB 96 GB usable | 614 GB/s | 150W | 70B+ | |
| Apple M5 Max (48GB) | Unified | 48 GB 36 GB usable | 614 GB/s | 150W | 32B | |
| Apple M5 Max (64GB) | Unified | 64 GB 48 GB usable | 614 GB/s | 150W | 32B | |
| Apple M5 Max (96GB) | Unified | 96 GB 72 GB usable | 614 GB/s | 150W | 70B+ | |
| Apple M5 Pro (24GB) | Unified | 24 GB 18 GB usable | 307 GB/s | 95W | 14B | |
| Apple M5 Pro (48GB) | Unified | 48 GB 36 GB usable | 307 GB/s | 95W | 32B | |
| Apple M5 Pro (64GB) | Unified | 64 GB 48 GB usable | 307 GB/s | 95W | 32B | |
| Arc A770 (16GB) | Discrete | 16 GB | 560 GB/s | 225W | 14B | |
| Arc B580 (12GB) | Discrete | 12 GB | 456 GB/s | 190W | 14B | |
| Instinct MI210 (64GB) | Discrete | 64 GB | 1638 GB/s | 300W | 70B+ | |
| Instinct MI250 (128GB) | Discrete | 128 GB | 3276 GB/s | 500W | 70B+ | |
| Instinct MI250X (128GB) | Discrete | 128 GB | 3276 GB/s | 560W | 70B+ | |
| Instinct MI300A (128GB) | Discrete | 128 GB | 5300 GB/s | 550W | 70B+ | |
| Instinct MI300X (192GB) | Discrete | 192 GB | 5300 GB/s | 750W | 70B+ | |
| Instinct MI325X (256GB) | Discrete | 256 GB | 6000 GB/s | 750W | 70B+ | |
| NVIDIA A100 (40GB) | Discrete | 40 GB | 1555 GB/s | 400W | 32B | |
| NVIDIA A100 (80GB) | Discrete | 80 GB | 2039 GB/s | 400W | 70B+ | |
| NVIDIA A10G (24GB) | Discrete | 24 GB | 600 GB/s | 300W | 32B | |
| NVIDIA A16 (64GB) | Discrete | 64 GB | 800 GB/s | 250W | 70B+ | |
| NVIDIA A2 (16GB) | Discrete | 16 GB | 200 GB/s | 60W | 14B | |
| NVIDIA A30 (24GB) | Discrete | 24 GB | 933 GB/s | 165W | 32B | |
| NVIDIA A40 (48GB) | Discrete | 48 GB | 696 GB/s | 300W | 32B | |
| NVIDIA A800 (40GB) | Discrete | 40 GB | 1555.2 GB/s | 400W | 32B | |
| NVIDIA A800 (80GB) | Discrete | 80 GB | 1935 GB/s | 400W | 70B+ | |
| NVIDIA B100 (192GB) | Discrete | 192 GB | 8000 GB/s | 1000W | 70B+ | |
| NVIDIA B200 (192GB) | Discrete | 192 GB | 8000 GB/s | 1200W | 70B+ | |
| NVIDIA Blackwell B300 (288GB) | Discrete | 288 GB | 8000 GB/s | 1000W | 70B+ | |
| NVIDIA GB10 Grace Blackwell (128GB) - DGX Spark | Discrete | 128 GB | 273.2 GB/s | 140W | 70B+ | |
| NVIDIA H100 (80GB) | Discrete | 80 GB | 3350 GB/s | 700W | 70B+ | |
| NVIDIA H100 NVL (94GB) | Discrete | 94 GB | 3938 GB/s | 700W | 70B+ | |
| NVIDIA H200 (141GB) | Discrete | 141 GB | 4800 GB/s | 700W | 70B+ | |
| NVIDIA H800 (80GB) | Discrete | 80 GB | 2000 GB/s | 700W | 70B+ | |
| NVIDIA L4 (24GB) | Discrete | 24 GB | 300 GB/s | 72W | 32B | |
| NVIDIA L40 (48GB) | Discrete | 48 GB | 864 GB/s | 300W | 32B | |
| NVIDIA L40S (48GB) | Discrete | 48 GB | 864 GB/s | 350W | 32B | |
| NVIDIA RTX 2000 Ada Generation (16GB) | Discrete | 16 GB | 224 GB/s | 70W | 14B | |
| NVIDIA RTX 3060 (12GB) | Discrete | 12 GB | 360 GB/s | 170W | 14B | |
| NVIDIA RTX 3060 Ti (8GB) | Discrete | 8 GB | 448 GB/s | 200W | 8B | |
| NVIDIA RTX 3070 (8GB) | Discrete | 8 GB | 448 GB/s | 220W | 8B | |
| NVIDIA RTX 3070 Ti (8GB) | Discrete | 8 GB | 608 GB/s | 290W | 8B | |
| NVIDIA RTX 3080 (10GB) | Discrete | 10 GB | 760.3 GB/s | 320W | 8B | |
| NVIDIA RTX 3080 (12GB) | Discrete | 12 GB | 912 GB/s | 350W | 14B | |
| NVIDIA RTX 3080 Ti (12GB) | Discrete | 12 GB | 912.4 GB/s | 350W | 14B | |
| NVIDIA RTX 3090 (24GB) | Discrete | 24 GB | 936.2 GB/s | 350W | 32B | |
| NVIDIA RTX 3090 Ti (24GB) | Discrete | 24 GB | 1008 GB/s | 450W | 32B | |
| NVIDIA RTX 4000 Ada Generation (20GB) | Discrete | 20 GB | 360 GB/s | 130W | 32B | |
| NVIDIA RTX 4060 (8GB) | Discrete | 8 GB | 272 GB/s | 115W | 8B | |
| NVIDIA RTX 4060 Ti (16GB) | Discrete | 16 GB | 288 GB/s | 165W | 14B | |
| NVIDIA RTX 4060 Ti (8GB) | Discrete | 8 GB | 288 GB/s | 160W | 8B | |
| NVIDIA RTX 4070 (12GB) | Discrete | 12 GB | 504 GB/s | 200W | 14B | |
| NVIDIA RTX 4070 SUPER (12GB) | Discrete | 12 GB | 504.2 GB/s | 220W | 14B | |
| NVIDIA RTX 4070 Ti (12GB) | Discrete | 12 GB | 504.2 GB/s | 285W | 14B | |
| NVIDIA RTX 4070 Ti SUPER (16GB) | Discrete | 16 GB | 672.3 GB/s | 285W | 14B | |
| NVIDIA RTX 4080 (16GB) | Discrete | 16 GB | 716.8 GB/s | 320W | 14B | |
| NVIDIA RTX 4080 SUPER (16GB) | Discrete | 16 GB | 736.3 GB/s | 320W | 14B | |
| NVIDIA RTX 4090 (24GB) | Discrete | 24 GB | 1008 GB/s | 450W | 32B | |
| NVIDIA RTX 4500 Ada Generation (24GB) | Discrete | 24 GB | 432 GB/s | 210W | 32B | |
| NVIDIA RTX 4500 Blackwell (32GB) | Discrete | 32 GB | 896 GB/s | 175W | 32B | |
| NVIDIA RTX 5000 Ada Generation (32GB) | Discrete | 32 GB | 576 GB/s | 250W | 32B | |
| NVIDIA RTX 5000 Blackwell (48GB) | Discrete | 48 GB | 1344 GB/s | 250W | 32B | |
| NVIDIA RTX 5060 (8GB) | Discrete | 8 GB | 448 GB/s | 130W | 8B | |
| NVIDIA RTX 5060 Ti (16GB) | Discrete | 16 GB | 448 GB/s | 185W | 14B | |
| NVIDIA RTX 5060 Ti (8GB) | Discrete | 8 GB | 448 GB/s | 180W | 8B | |
| NVIDIA RTX 5070 (12GB) | Discrete | 12 GB | 672 GB/s | 220W | 14B | |
| NVIDIA RTX 5070 Ti (16GB) | Discrete | 16 GB | 896 GB/s | 300W | 14B | |
| NVIDIA RTX 5080 (16GB) | Discrete | 16 GB | 960 GB/s | 360W | 14B | |
| NVIDIA RTX 5090 (32GB) | Discrete | 32 GB | 1792 GB/s | 575W | 32B | |
| NVIDIA RTX 6000 Ada Generation (48GB) | Discrete | 48 GB | 960 GB/s | 300W | 32B | |
| NVIDIA RTX 6000 Blackwell (96GB) | Discrete | 96 GB | 1792 GB/s | 500W | 70B+ | |
| NVIDIA RTX A4000 (16GB) | Discrete | 16 GB | 448 GB/s | 140W | 14B | |
| NVIDIA RTX A5000 (24GB) | Discrete | 24 GB | 768 GB/s | 230W | 32B | |
| NVIDIA RTX A6000 (48GB) | Discrete | 48 GB | 768 GB/s | 300W | 32B | |
| NVIDIA RTX PRO 4000 Blackwell (24GB) | Discrete | 24 GB | 672 GB/s | 145W | 32B | |
| NVIDIA RTX PRO 4000 Blackwell SFF (24GB) | Discrete | 24 GB | 432 GB/s | 70W | 32B | |
| NVIDIA Rubin R100 (288GB) | Discrete | 288 GB | 22000 GB/s | 1000W | 70B+ | |
| NVIDIA T4 (16GB) | Discrete | 16 GB | 320 GB/s | 70W | 14B | |
| Radeon PRO W6600 (8GB) | Discrete | 8 GB | 224 GB/s | 100W | 8B | |
| Radeon PRO W6800 (32GB) | Discrete | 32 GB | 512 GB/s | 250W | 32B | |
| Radeon PRO W7800 (32GB) | Discrete | 32 GB | 576 GB/s | 260W | 32B | |
| Radeon PRO W7900 (48GB) | Discrete | 48 GB | 864 GB/s | 295W | 32B |
©2025 ApX Machine Learning