Llama 4 Scout 17B-16E hardware requirements
109B parameters (17B active, mixture of experts). Needs about 68.3 GB at Q4_K_M with 8K context. Model card.
Memory needed at each quantization
| Quant | Quality | 8K context | 32K context |
|---|---|---|---|
| FP16 | Full quality | 220.2 GB | 225 GB |
| Q8_0 | Near-lossless | 118 GB | 122.9 GB |
| Q6_K | Excellent | 91.6 GB | 96.4 GB |
| Q5_K_M | Very good | 79.7 GB | 84.6 GB |
| Q4_K_M | Good, most popular | 68.3 GB | 73.1 GB |
| Q3_K_M | Noticeably degraded | 55.5 GB | 60.3 GB |
| Q2_K | Heavily degraded | 43.1 GB | 47.9 GB |
Run it with Ollama: ollama run llama4:scout (downloads Q4_K_M by default).
Run it in the cloud
Don't want to buy hardware? Run Llama 4 Scout 17B-16E on a rented GPU today.
Rent a cloud GPU by the hour. No upfront cost, cancel any time.
Every GPU and Mac checked
| GPU | Runs? | Best fit |
|---|---|---|
| NVIDIA RTX 3060 12GB | No | Needs ~68.3 GB at Q4_K_M; 12 GB available |
| NVIDIA RTX 3070 | No | Needs ~68.3 GB at Q4_K_M; 8 GB available |
| NVIDIA RTX 3080 10GB | No | Needs ~68.3 GB at Q4_K_M; 10 GB available |
| NVIDIA RTX 3090 | No | Needs ~68.3 GB at Q4_K_M; 24 GB available |
| NVIDIA RTX 4060 | No | Needs ~68.3 GB at Q4_K_M; 8 GB available |
| NVIDIA RTX 4060 Ti 16GB | No | Needs ~68.3 GB at Q4_K_M; 16 GB available |
| NVIDIA RTX 5060 Ti 16GB | No | Needs ~68.3 GB at Q4_K_M; 16 GB available |
| NVIDIA RTX 4070 | No | Needs ~68.3 GB at Q4_K_M; 12 GB available |
| NVIDIA RTX 4070 Ti Super | No | Needs ~68.3 GB at Q4_K_M; 16 GB available |
| NVIDIA RTX 4080 | No | Needs ~68.3 GB at Q4_K_M; 16 GB available |
| NVIDIA RTX 4090 | No | Needs ~68.3 GB at Q4_K_M; 24 GB available |
| NVIDIA RTX 5070 | No | Needs ~68.3 GB at Q4_K_M; 12 GB available |
| NVIDIA RTX 5070 Ti | No | Needs ~68.3 GB at Q4_K_M; 16 GB available |
| NVIDIA RTX 5080 | No | Needs ~68.3 GB at Q4_K_M; 16 GB available |
| NVIDIA RTX 5090 | No | Needs ~68.3 GB at Q4_K_M; 32 GB available |
| AMD Radeon RX 7800 XT | No | Needs ~68.3 GB at Q4_K_M; 16 GB available |
| AMD Radeon RX 7900 XTX | No | Needs ~68.3 GB at Q4_K_M; 24 GB available |
| Apple M4 (16GB) | No | Needs ~68.3 GB at Q4_K_M; 10.7 GB available |
| Apple M1 (16GB) | No | Needs ~68.3 GB at Q4_K_M; 10.7 GB available |
| Apple M2 Pro (32GB) | No | Needs ~68.3 GB at Q4_K_M; 21.4 GB available |
| Apple M3 Max (64GB) | Yes, with heavy quantization | Q2_K · ~43.1 GB · ~38 tok/s |
| Apple M4 Pro (48GB) | No | Needs ~68.3 GB at Q4_K_M; 36 GB available |
| Apple M4 Max (128GB) | Yes | Q6_K · ~91.6 GB · ~24 tok/s |
| Apple M2 Ultra (192GB) | Yes | Q8_0 · ~118 GB · ~27 tok/s |