Can the AMD Radeon RX 7900 XTX run Qwen3 32B?
- FP16
- Q8_0
- Q6_K
- Q5_K_M
- Q4_K_M
- Q3_K_M
- Q2_K
Yes. The AMD Radeon RX 7900 XTX can run Qwen3 32B fully in VRAM at Q4_K_M (good, most popular), using about 22.6 GB of the 24 GB available, at roughly 29 tokens/second.
Run it with Ollama
With Ollama installed, one command downloads and starts Qwen3 32B:
ollama run qwen3:32bOllama's default download is Q4_K_M (about 22.6 GB here). That is also the best quant that fits.
New to this? Step-by-step setup for the Radeon RX 7900 XTX
Run it in the cloud
No AMD Radeon RX 7900 XTX? Run Qwen3 32B in the cloud.
Rent a cloud GPU by the hour. No upfront cost, stop any time.
Memory needed by quantization
At 8,192 tokens of context. The black line marks the 24 GB the AMD Radeon RX 7900 XTX can use.
| Quant | Quality | Memory | Fits? | Speed | |
|---|---|---|---|---|---|
| FP16 | Full quality | 68.3 GB | Too big | — | |
| Q8_0 | Near-lossless | 37.6 GB | Too big | — | |
| Q6_K | Excellent | 29.6 GB | Too big | — | |
| Q5_K_M | Very good | 26.1 GB | Too big | — | |
| Q4_K_M | Good, most popular | 22.6 GB | Fits | ~29 tok/s | |
| Q3_K_M | Noticeably degraded | 18.8 GB | Fits | ~36 tok/s | |
| Q2_K | Heavily degraded | 15 GB | Fits | ~47 tok/s |
GPUs that run Qwen3 32B comfortably
Frequently asked questions
Can AMD Radeon RX 7900 XTX run Qwen3 32B?
Yes. The AMD Radeon RX 7900 XTX can run Qwen3 32B fully in VRAM at Q4_K_M (good, most popular), using about 22.6 GB of the 24 GB available, at roughly 29 tokens/second.
How much VRAM does Qwen3 32B need?
About 22.6 GB at Q4_K_M with 8,192 tokens of context, and about 68.3 GB at full FP16 precision.
How fast is Qwen3 32B on the AMD Radeon RX 7900 XTX?
Roughly 29 tokens per second at Q4_K_M, estimated from the AMD Radeon RX 7900 XTX's 960 GB/s memory bandwidth.