Qwen3.8-Flash-Next-hibrid48
5recorded runs
474.0best tok/s
5verified
What the Qwen3.8-Flash-Next-hibrid48 numbers mean
The fastest verified result on our board is 474.0 output tok/s on an DGX Spark x2 at NVFP4 (output head) with a 262144-token context. That is about 2.1 ms per generated token — 500 tokens takes roughly 1.1 seconds. Across the 5 records we hold for this model the range is 60.0–474.0 tok/s on 2 GPUs, because quantisation, context length and the engine build all move the number.
How much VRAM does Qwen3.8-Flash-Next-hibrid48 need?
Qwen3.8-Flash-Next-hibrid48 has 180.0B parameters. These estimates use the same formula as the VRAM calculator: weights, plus about 15% for a moderate-context KV cache and runtime overhead, plus a small engine floor.
| Quantisation | Estimated VRAM | Smallest card that fits |
|---|---|---|
| Q4_K_M (4-bit) | 117.2 GB | 141 GB |
| Q8_0 (8-bit) | 220.7 GB | multi-GPU or CPU offload |
| FP16 (16-bit) | 414.8 GB | multi-GPU or CPU offload |
Fastest GPUs for this model (best tok/s)
- DGX Spark x2474.0
- DGX Spark60.0
Models with a similar footprint
| Model | Params | Q4_K_M weights |
|---|---|---|
| CYBER-FROST-3.8 | 180B | 101.2 GB |
| Qwen3.8-Flash-Next | 180B | 101.2 GB |
| Qwen3.8-Flash-Next-REAP-256-duo | 180B | 101.2 GB |
| DeepSeek-V4-Flash-180B | 158B | 88.9 GB |
| MiniMax-M2.7 | 229B | 128.8 GB |
| Ling-3.0-flash | 127B | 71.4 GB |
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| DGX Spark x2 · 128 GB | Qwen3.8-Flash-Next-hibrid48 | NVFP4 (output head) | vllm 0.29 | 262144 | 474.0 ✓ | — | — | src |
| DGX Spark x2 · 128 GB | Qwen3.8-Flash-Next-hibrid48 | NVFP4 | vllm 0.30 | 1000 | 99.0 ✓ | 2543.0 | — | src |
| DGX Spark x2 · 128 GB | Qwen3.8-Flash-Next-hibrid48 | NVFP4 | vllm 0.30 | 128000 | 89.8 ✓ | 3233.0 | — | src |
| DGX Spark x2 · 128 GB | Qwen3.8-Flash-Next-hibrid48 | NVFP4 | vllm 0.30 | 256000 | 81.6 ✓ | 3094.0 | — | src |
| DGX Spark · 128 GB | Qwen3.8-Flash-Next-hibrid48 | NVFP4 (output head) | vllm 0.29.0 | 262000 | 60.0 ✓ | — | — | src |