Home / Will it run? / Qwen3 32B
Alibaba Qwen · Qwen3
Will Qwen3 32B run on my GPU?
32.8B parameters, 32,768-token context, Apache-2.0. At Q4_K_M the weights come to about 18.3 GiB; add 1.5 GiB for the runtime and you need roughly 19.8 GiB of VRAM before context.
Weights by quant
GiBQ4_K_M · the everyday quant18.3 GiB
Q8_0 · near-lossless32.4 GiB
FP16 · full weights61.1 GiB
Runtime reserve1.5 GiB
Card by card
4 of 18 fit at Q4Headroom is what remains for the KV cache after weights and the 1.5 GiB reserve. How far it stretches depends on the architecture: grouped-query models are frugal, older dense models are not. If the table says tight, plan on a shorter context or a lower quant. Parameter count from the model's own card. The Buy column opens live Amazon listings; those links may earn us a commission.