Which AI models can the Apple M1 (16GB) run?

Every model we track, checked against the Apple M1 (16GB) at 8K context.

ModelRuns?Best fit
Llama 3.2 1BYesFP16 · ~3.3 GB · ~16 tok/s
Llama 3.2 3BYesFP16 · ~8 GB · ~6 tok/s
Llama 3.1 8BYesQ8_0 · ~10.2 GB · ~5 tok/s
Llama 3.1 70BNoNeeds ~46.1 GB at Q4_K_M; 10.7 GB available
Qwen2.5 7BYesQ8_0 · ~9.2 GB · ~5 tok/s
Qwen2.5 14BYes, with heavy quantizationQ3_K_M · ~9.4 GB · ~6 tok/s
Qwen2.5 32BNoNeeds ~22.6 GB at Q4_K_M; 10.7 GB available
Qwen2.5 72BNoNeeds ~47.4 GB at Q4_K_M; 10.7 GB available
Qwen3 8BYesQ8_0 · ~10.5 GB · ~5 tok/s
Qwen3 30B-A3BNoNeeds ~19.9 GB at Q4_K_M; 10.7 GB available
DeepSeek R1 Distill Qwen 32BNoNeeds ~22.6 GB at Q4_K_M; 10.7 GB available
Mistral 7B v0.3YesQ8_0 · ~9.4 GB · ~5 tok/s
Mistral Nemo 12BYesQ5_K_M · ~10.6 GB · ~5 tok/s
Mistral Small 24BNoNeeds ~16.2 GB at Q4_K_M; 10.7 GB available
Mixtral 8x7BNoNeeds ~30 GB at Q4_K_M; 10.7 GB available
Gemma 2 9BYesQ5_K_M · ~10 GB · ~6 tok/s
Gemma 2 27BNoNeeds ~20.2 GB at Q4_K_M; 10.7 GB available
Gemma 3 4BYesFP16 · ~10.3 GB · ~5 tok/s
Gemma 3 12BYes, with heavy quantizationQ3_K_M · ~9.8 GB · ~7 tok/s
Gemma 3 27BNoNeeds ~21.4 GB at Q4_K_M; 10.7 GB available
Phi-3.5 Mini 3.8BYesQ8_0 · ~7.9 GB · ~10 tok/s
Phi-4 14BYes, with heavy quantizationQ3_K_M · ~9.5 GB · ~6 tok/s
Qwen3 4BYesFP16 · ~9.8 GB · ~5 tok/s
Qwen3 14BYes, with heavy quantizationQ3_K_M · ~9.2 GB · ~6 tok/s
Qwen3 32BNoNeeds ~22.6 GB at Q4_K_M; 10.7 GB available
Qwen3 Coder 30B-A3BNoNeeds ~19.9 GB at Q4_K_M; 10.7 GB available
gpt-oss 20BYes, with heavy quantizationQ2_K · ~8.8 GB · ~30 tok/s
gpt-oss 120BNoNeeds ~72 GB at Q4_K_M; 10.7 GB available
Llama 4 Scout 17B-16ENoNeeds ~68.3 GB at Q4_K_M; 10.7 GB available
Run it in the cloud

Need more than 16 GB? Rent a bigger GPU by the hour.

Rent a cloud GPU by the hour. No upfront cost, cancel any time.