picksbycard
October 13, 2026No. 164
Home / Will it run? / Llama 4 Maverick (17B x 128E) Instruct
Meta · Llama 4

Will Llama 4 Maverick (17B x 128E) Instruct run on my GPU?

400B parameters (mixture of experts, 17B active per token, but every expert must sit in memory), 1,048,576-token context, Llama 4 Community License. At Q4_K_M the weights come to about 223.5 GiB; add 1.5 GiB for the runtime and you need roughly 225.0 GiB of VRAM before context.

Weights by quant

GiB
Q4_K_M · the everyday quant223.5 GiB
Q8_0 · near-lossless394.9 GiB
FP16 · full weights745.1 GiB
Runtime reserve1.5 GiB

Card by card

0 of 18 fit at Q4
CardVRAMQ4_K_MQ8_0FP16Headroom at Q4Buy
GeForce RTX 5090NVIDIA 32GB NoNoNo short by 193.0 GiB $8,757 →
GeForce RTX 3090 (used)NVIDIA · used market 24GB NoNoNo short by 201.0 GiB $2,404 →
GeForce RTX 4090 (used)NVIDIA · used market 24GB NoNoNo short by 201.0 GiB $4,663 →
Radeon RX 7900 XTXAMD 24GB NoNoNo short by 201.0 GiB $1,552 →
GeForce RTX 5060 Ti 16GBNVIDIA 16GB NoNoNo short by 209.0 GiB $1,146 →
GeForce RTX 5070 TiNVIDIA 16GB NoNoNo short by 209.0 GiB $1,792 →
GeForce RTX 5080NVIDIA 16GB NoNoNo short by 209.0 GiB $2,399 →
Radeon RX 7800 XTAMD 16GB NoNoNo short by 209.0 GiB $834 →
Radeon RX 9060 XT 16GBAMD 16GB NoNoNo short by 209.0 GiB $812 →
Radeon RX 9070AMD 16GB NoNoNo short by 209.0 GiB $1,052 →
Radeon RX 9070 XTAMD 16GB NoNoNo short by 209.0 GiB $1,194 →
Arc B580Intel 12GB NoNoNo short by 213.0 GiB $446 →
GeForce RTX 3060 12GB (used)NVIDIA · used market 12GB NoNoNo short by 213.0 GiB $588 →
GeForce RTX 4070 SuperNVIDIA · used market 12GB NoNoNo short by 213.0 GiB $1,156 →
GeForce RTX 5070NVIDIA 12GB NoNoNo short by 213.0 GiB $1,086 →
Arc B570Intel 10GB NoNoNo short by 215.0 GiB $299 →
GeForce RTX 5060NVIDIA 8GB NoNoNo short by 217.0 GiB $550 →
GeForce RTX 5060 Ti 8GBNVIDIA 8GB NoNoNo short by 217.0 GiB $809 →

Headroom is what remains for the KV cache after weights and the 1.5 GiB reserve. How far it stretches depends on the architecture: grouped-query models are frugal, older dense models are not. If the table says tight, plan on a shorter context or a lower quant. Parameter count from the model's own card. The Buy column opens live Amazon listings; those links may earn us a commission.

The Silicon Note

One short read on the GPU market, most mornings. No spam, one-click out.