Which AI models can the Apple M4 Max (128GB) run?
- 128 GB unified memory
- 546 GB/s bandwidth
- Apple
Every model we track, checked against the Apple M4 Max (128GB) at 8K context.
| Model | Runs? | Best fit |
|---|---|---|
| Llama 3.2 1B | Yes | FP16 · ~3.3 GB · ~132 tok/s |
| Llama 3.2 3B | Yes | FP16 · ~8 GB · ~51 tok/s |
| Llama 3.1 8B | Yes | FP16 · ~17.7 GB · ~20 tok/s |
| Llama 3.1 70B | Yes | Q8_0 · ~78.3 GB · ~4 tok/s |
| Qwen2.5 7B | Yes | FP16 · ~16.3 GB · ~21 tok/s |
| Qwen2.5 14B | Yes | FP16 · ~31.6 GB · ~11 tok/s |
| Qwen2.5 32B | Yes | FP16 · ~68.3 GB · ~5 tok/s |
| Qwen2.5 72B | Yes | Q8_0 · ~80.5 GB · ~4 tok/s |
| Qwen3 8B | Yes | FP16 · ~18.2 GB · ~20 tok/s |
| Qwen3 30B-A3B | Yes | FP16 · ~62.4 GB · ~50 tok/s |
| DeepSeek R1 Distill Qwen 32B | Yes | FP16 · ~68.3 GB · ~5 tok/s |
| Mistral 7B v0.3 | Yes | FP16 · ~16.2 GB · ~23 tok/s |
| Mistral Nemo 12B | Yes | FP16 · ~26.3 GB · ~13 tok/s |
| Mistral Small 24B | Yes | FP16 · ~49.1 GB · ~7 tok/s |
| Mixtral 8x7B | Yes | FP16 · ~95.1 GB · ~13 tok/s |
| Gemma 2 9B | Yes | FP16 · ~21.9 GB · ~18 tok/s |
| Gemma 2 27B | Yes | FP16 · ~58.1 GB · ~6 tok/s |
| Gemma 3 4B | Yes | FP16 · ~10.3 GB · ~38 tok/s |
| Gemma 3 12B | Yes | FP16 · ~28.2 GB · ~13 tok/s |
| Gemma 3 27B | Yes | FP16 · ~59.6 GB · ~6 tok/s |
| Phi-3.5 Mini 3.8B | Yes | FP16 · ~11.5 GB · ~43 tok/s |
| Phi-4 14B | Yes | FP16 · ~31.7 GB · ~11 tok/s |
| Qwen3 4B | Yes | FP16 · ~9.8 GB · ~41 tok/s |
| Qwen3 14B | Yes | FP16 · ~31.5 GB · ~11 tok/s |
| Qwen3 32B | Yes | FP16 · ~68.3 GB · ~5 tok/s |
| Qwen3 Coder 30B-A3B | Yes | FP16 · ~62.4 GB · ~50 tok/s |
| gpt-oss 20B | Yes | FP16 · ~42.8 GB · ~45 tok/s |
| gpt-oss 120B | Yes | Q5_K_M · ~84.3 GB · ~90 tok/s |
| Llama 4 Scout 17B-16E | Yes | Q6_K · ~91.6 GB · ~24 tok/s |
Run it in the cloud
Need more than 128 GB? Rent a bigger GPU by the hour.
Rent a cloud GPU by the hour. No upfront cost, cancel any time.