Skip to content

Qwen3-Coder-Next 80B-A3B VRAM Requirements

Alibaba, China · Released January 30, 2026

Qwen3-Coder-Next 80B-A3B has 79.7B parameters (3B active per token). In BF16 its weights alone take 148 GiB; quantized to 4-bit, about 44.9 GiB. Each 32K-token request adds 0.75 GiB of KV cache. Cheapest way to run it today: 3 × GeForce RTX 3090 (24 GB) at $0.429 per hour.

Size your own setup in the calculator →

VRAM by precision and context length

Weights plus the KV cache of one request (BF16 cache) and the model's fixed recurrent state, in GiB. Add 1 to 3 GiB for the inference engine itself.

Weights formatWeights only+ 8K context+ 32K context+ 128K context+ 256K context
BF16 / FP16148149149151154
FP8 / INT874.875.075.677.980.9
4-bit (GGUF Q4_K_M)44.945.145.747.950.9

Qwen3-Coder-Next 80B-A3B GGUF files

Exact size of each quantization in unsloth/Qwen3-Coder-Next-GGUF (opens in a new tab), and the smallest GPU that runs it with llama.cpp, Ollama or LM Studio and an 8K-token context.

QuantizationFile sizeSmallest GPU
BF16149 GiBMore than 96 GB: see the calculator
UD-Q8_K_XL80.4 GiBRTX PRO 6000 Blackwell (96 GB)
Q8_079.0 GiBRTX PRO 6000 Blackwell (96 GB)
UD-Q6_K_XL68.1 GiBRTX PRO 6000 Blackwell (96 GB)
UD-Q6_K61.3 GiBRTX PRO 6000 Blackwell (96 GB)
Q6_K61.1 GiBRTX PRO 6000 Blackwell (96 GB)
UD-Q5_K_XL55.5 GiBRTX PRO 6000 Blackwell (96 GB)
UD-Q5_K_M55.2 GiBRTX PRO 6000 Blackwell (96 GB)
Q5_K_M52.9 GiBRTX PRO 6000 Blackwell (96 GB)
UD-Q5_K_S52.0 GiBRTX PRO 6000 Blackwell (96 GB)
Q5_K_S51.3 GiBRTX PRO 6000 Blackwell (96 GB)
Q4_146.6 GiBRTX PRO 6000 Blackwell (96 GB)
UD-Q4_K_XL46.2 GiBRTX PRO 6000 Blackwell (96 GB)
UD-Q4_K_M45.9 GiBRTX PRO 6000 Blackwell (96 GB)
Q4_K_M45.2 GiBRTX PRO 6000 Blackwell (96 GB)
MXFP4_MOE44.7 GiBRTX PRO 6000 Blackwell (96 GB)
UD-Q4_K_S42.9 GiBRTX 6000 Ada (48 GB)
Q4_K_S42.4 GiBRTX 6000 Ada (48 GB)
Q4_042.2 GiBRTX 6000 Ada (48 GB)
IQ4_NL42.0 GiBRTX 6000 Ada (48 GB)
IQ4_XS39.7 GiBRTX 6000 Ada (48 GB)
UD-IQ4_NL36.5 GiBRTX 6000 Ada (48 GB)
UD-IQ4_XS35.8 GiBRTX 6000 Ada (48 GB)
Q3_K_M35.7 GiBRTX 6000 Ada (48 GB)
UD-Q3_K_XL33.8 GiBRTX 6000 Ada (48 GB)
UD-Q3_K_M33.5 GiBRTX 6000 Ada (48 GB)
Q3_K_S32.2 GiBRTX 6000 Ada (48 GB)
UD-Q3_K_S31.0 GiBRTX 6000 Ada (48 GB)
UD-IQ3_S27.7 GiBRTX 5090 (32 GB)
Q2_K_L27.3 GiBRTX 5090 (32 GB)
Q2_K27.2 GiBRTX 5090 (32 GB)
UD-IQ3_XXS26.5 GiBRTX 5090 (32 GB)
UD-Q2_K_XL24.9 GiBRTX 5090 (32 GB)
UD-IQ2_M23.2 GiBRTX 5090 (32 GB)
UD-IQ2_XXS21.7 GiBRTX 4090 (24 GB)
UD-IQ1_M20.2 GiBRTX 4090 (24 GB)
UD-IQ1_S20.0 GiBRTX 4090 (24 GB)
UD-TQ1_017.6 GiBRTX 4090 (24 GB)

Read every day from Hugging Face. Split files are added together; vision projectors are left out.

How many GPUs to run Qwen3-Coder-Next 80B-A3B

Fewest GPUs that fit the weights plus one 8K-token request. Data-center GPUs use vLLM (90% of memory usable), the others llama.cpp. Several GPUs split the model with tensor or pipeline parallelism.

GPUBF16 / FP16FP8 / INT84-bit (GGUF Q4_K_M)
GeForce RTX 4090 24 GB743
GeForce RTX 5090 32 GB632
RTX PRO 6000 Blackwell 96 GB211
Mac M5 Max 128 GB 96 GB usable211
NVIDIA H100 80 GB321
NVIDIA H200 141 GB211
NVIDIA B200 (HGX) 180 GB111

Cheapest way to run Qwen3-Coder-Next 80B-A3B today

For each GPU: the fewest cards that fit Qwen3-Coder-Next 80B-A3B with one 8K-token request, the most faithful weight format at that count, and the cheapest on-demand price (2026-10-10).

On-demand prices from RunPod, Vast.ai, Verda and Azure, checked every hour. Serving many users needs more KV cache, so more memory: size it in the calculator. Some links are affiliate links: StudioTV may earn a commission, at no extra cost to you.

KV cache: how memory grows with context

Architecture: MoE 512 experts · KV on 12 of 48 layers (GQA, 2 KV heads × 256) · 36 Gated DeltaNet layers. Its KV cache is 4.0× smaller than if every layer used full attention, because only 12 of its 48 layers keep a KV cache; the others hold a small fixed-size state. Only 3B parameters are active per token, but all 80B must sit in memory: VRAM depends on the total, speed on the active part.

Context per requestBF16 cacheFP8 cache
8K tokens0.19 GiB0.09 GiB
32K tokens0.75 GiB0.38 GiB
128K tokens3.00 GiB1.50 GiB
256K tokens6.00 GiB3.00 GiB

Plus 73.7 MiB of recurrent state per request, whatever the context.

Qwen3-Coder-Next 80B-A3B VRAM FAQ

How much VRAM does Qwen3-Coder-Next 80B-A3B need?

In BF16 the weights alone take 148 GiB (159 GB). In FP8 that is 74.8 GiB, and about 44.9 GiB with 4-bit quantization (Q4_K_M). Each request then adds KV cache: 0.19 GiB at 8K tokens and 0.75 GiB at 32K (BF16 cache).

Can Qwen3-Coder-Next 80B-A3B run on a single RTX 4090 (24 GB)?

No. Even in 4-bit it needs 3 RTX 4090s. In 4-bit it fits on a single RTX PRO 6000 Blackwell (96 GB).

What is the cheapest way to run Qwen3-Coder-Next 80B-A3B?

On 2026-10-10, the cheapest on-demand setup is 3 × GeForce RTX 3090 (24 GB) with 4-bit (GGUF Q4_K_M) weights on Vast.ai, at $0.429 per hour (about $313.17 per month). Next: 2 × NVIDIA A100 40GB with 4-bit (GGUF Q4_K_M) weights on Vast.ai, at $0.802 per hour. Sized for one 8K-token request; prices are checked every hour.

How many H100 GPUs does Qwen3-Coder-Next 80B-A3B need?

With one request and an 8K-token context: 3 in BF16, 2 in FP8 and 1 in 4-bit (vLLM, 90% of memory usable). Serving many users at once needs more memory for their KV caches: the calculator sizes that for you.

Qwen3-Coder-Next 80B-A3B VRAM badge

For a model card or a README: the 4-bit size and the smallest GPU it fits on, linked to this page. Data as JSON: /api/models/qwen3-coder-next.json.

Qwen3-Coder-Next 80B-A3B VRAM badge

[![Qwen3-Coder-Next 80B-A3B VRAM](https://studiotvai.com/badge/qwen3-coder-next.svg)](https://studiotvai.com/vram-requirements/qwen3-coder-next)

Other models

Same family (coding models): Qwen3-Coder 30B-A3B · Qwen3-Coder 480B-A35B

All models: Llama 3.1 8B · Mistral Small 3.2 24B · Qwen3 32B · Llama 3.3 70B · Llama 3.1 405B · Qwen3.5 4B · Qwen3.5 9B · Qwen3.8 27B · Qwen3.6 35B-A3B · Qwen3.5 122B-A10B · Qwen3.8-Flash-Next · LFM2.5 8B-A1B · LFM2 24B-A2B · Gemma 4 12B · Gemma 4 31B · Gemma 4 26B-A4B · gpt-oss 20B · gpt-oss 120B · Llama 4 Scout 17B-16E · Llama 4 Maverick 17B-128E · Kolibri-1 · Nemotron 3 Nano 30B-A3B · Nemotron 3 Super 120B-A12B · MiniMax M2.7 · DeepSeek R1 · Kimi K2.6 · GLM-5.3 · GLM-5.3-Flash · DeepSeek V4 Flash · DeepSeek V4 Pro · DeepSeek V4.1 Flash · MiMo-V2.6 Pro · MiMo-V2.6 Flash · Kimi K3 · Mistral Large 4 · Qwen3-Coder 30B-A3B · Qwen3-Coder 480B-A35B · DeepSeek V4 Flash Vision Exp · Qwen3.8 2.4T-A95B · Ornith 1.5 397B · Ornith 1.5 35B-A3B · Ornith 1.5 9B · Atria Dawn Preview · Intern S2 397B · Clef · Clef Flash · D1 3B · Humanizer · JEV 27B VL · Mellum2.1 12B-A2.5B · LightOnOCR-3 4B · Spark-X2.5 4B · Agnes-3.0-Qwen

Estimates, not guarantees: computed from the official config.json with the same engine as the LLM VRAM Calculator. Real usage depends on your engine version and settings.