Qwen3.8-Flash-Next-REAP-256-duo
1recorded run
53.5best tok/s
1verified
What the Qwen3.8-Flash-Next-REAP-256-duo numbers mean
The fastest verified result on our board is 53.5 output tok/s on an RTX 3090 x2 at Unsloth-Dynamic-Q3_K_XL with a 32768-token context. That is about 18.7 ms per generated token — 500 tokens takes roughly 9.3 seconds. Prompt processing on the same record runs at 948.6 tok/s, so a 2,000-token prompt is read in about 2.1 seconds. Peak VRAM was measured at 33.9 GB.
How much VRAM does Qwen3.8-Flash-Next-REAP-256-duo need?
Qwen3.8-Flash-Next-REAP-256-duo has 180.0B parameters. These estimates use the same formula as the VRAM calculator: weights, plus about 15% for a moderate-context KV cache and runtime overhead, plus a small engine floor.
| Quantisation | Estimated VRAM | Smallest card that fits |
|---|---|---|
| Q4_K_M (4-bit) | 117.2 GB | 141 GB |
| Q8_0 (8-bit) | 220.7 GB | multi-GPU or CPU offload |
| FP16 (16-bit) | 414.8 GB | multi-GPU or CPU offload |
Fastest GPUs for this model (best tok/s)
- RTX 3090 x253.5
Models with a similar footprint
| Model | Params | Q4_K_M weights |
|---|---|---|
| CYBER-FROST-3.8 | 180B | 101.2 GB |
| Qwen3.8-Flash-Next | 180B | 101.2 GB |
| Qwen3.8-Flash-Next-hibrid48 | 180B | 101.2 GB |
| DeepSeek-V4-Flash-180B | 158B | 88.9 GB |
| MiniMax-M2.7 | 229B | 128.8 GB |
| Ling-3.0-flash | 127B | 71.4 GB |
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| RTX 3090 x2 · 24 GB | Qwen3.8-Flash-Next-REAP-256-duo | Unsloth-Dynamic-Q3_K_XL | llama.cpp 0.3.0-dev / commit 035e227 (llamacpp… | 32768 | 53.5 ✓ | 948.6 | 33.9 | src |