DeepSeek-V4.1-Flash
39recorded runs
231.6best tok/s
39verified
What the DeepSeek-V4.1-Flash numbers mean
The fastest verified result on our board is 231.6 output tok/s on an RTX PRO 6000 Blackwell x4 at FP4+FP8 native with a 65536-token context. That is about 4.3 ms per generated token — 500 tokens takes roughly 2.2 seconds. Prompt processing on the same record runs at 7346.3 tok/s, so a 2,000-token prompt is read in about 0.3 seconds. Across the 39 records we hold for this model the range is 2.7–231.6 tok/s on 6 GPUs, because quantisation, context length and the engine build all move the number.
How much VRAM does DeepSeek-V4.1-Flash need?
DeepSeek-V4.1-Flash has 552.0B parameters. These estimates use the same formula as the VRAM calculator: weights, plus about 15% for a moderate-context KV cache and runtime overhead, plus a small engine floor.
| Quantisation | Estimated VRAM | Smallest card that fits |
|---|---|---|
| Q4_K_M (4-bit) | 357.9 GB | multi-GPU or CPU offload |
| Q8_0 (8-bit) | 675.3 GB | multi-GPU or CPU offload |
| FP16 (16-bit) | 1270.4 GB | multi-GPU or CPU offload |
Fastest GPUs for this model (best tok/s)
- RTX PRO 6000 Blackwell x4231.6
- DGX Spark x2154.0
- DGX Spark x482.0
- DGX Spark47.0
- DGX Spark x346.0
Models with a similar footprint
| Model | Params | Q4_K_M weights |
|---|---|---|
| DeepSeek-V4.1-Flash-1017 | 552B | 310.5 GB |
| GLM-5.2 | 753B | 423.6 GB |
| GLM-5.3-Flash | 321B | 180.6 GB |
| DeepSeek-V4-Flash-Vision-Exp | 305B | 171.6 GB |
| keys-DeepSeekV4Flash-Vision-EXP-ablit | 305B | 171.6 GB |
| DeepSeek-V4-Flash-0731 | 304B | 171.0 GB |
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| RTX PRO 6000 Blackwell x4 · 384 GB | DeepSeek-V4.1-Flash | FP4+FP8 native | sglang lmsysorg/sglang c4ca6511 + nvme/DDR5… | 65536 | 231.6 ✓ | 7346.3 | — | src |
| RTX PRO 6000 Blackwell x4 · 384 GB | DeepSeek-V4.1-Flash | FP4+FP8 native | sglang lmsysorg/sglang c4ca6511 + nvme/DDR5… | 2048 | 226.8 ✓ | 7010.3 | — | src |
| RTX PRO 6000 Blackwell x4 · 384 GB | DeepSeek-V4.1-Flash | FP4+FP8 native | sglang lmsysorg/sglang c4ca6511 + nvme/DDR5… | 400000 | 220.2 ✓ | 6081.4 | — | src |
| RTX PRO 6000 Blackwell x4 · 384 GB | DeepSeek-V4.1-Flash | FP4+FP8 native | sglang lmsysorg/sglang c4ca6511 + nvme/DDR5… | 500000 | 212.4 ✓ | 5844.5 | — | src |
| RTX PRO 6000 Blackwell x4 · 384 GB | DeepSeek-V4.1-Flash | FP4+FP8 native | sglang lmsysorg/sglang c4ca6511 + nvme/DDR5… | 32768 | 211.5 ✓ | 7438.7 | — | src |
| RTX PRO 6000 Blackwell x4 · 384 GB | DeepSeek-V4.1-Flash | FP4+FP8 native | sglang lmsysorg/sglang c4ca6511 + nvme/DDR5… | 131072 | 203.3 ✓ | 7064.6 | — | src |
| RTX PRO 6000 Blackwell x4 · 384 GB | DeepSeek-V4.1-Flash | FP4+FP8 native | sglang lmsysorg/sglang c4ca6511 + nvme/DDR5… | 200000 | 202.2 ✓ | 6802.6 | — | src |
| RTX PRO 6000 Blackwell x4 · 384 GB | DeepSeek-V4.1-Flash | FP4+FP8 native | sglang lmsysorg/sglang c4ca6511 + nvme/DDR5… | 512 | 200.9 ✓ | 1943.0 | — | src |
| RTX PRO 6000 Blackwell x4 · 384 GB | DeepSeek-V4.1-Flash | FP4+FP8 native | sglang lmsysorg/sglang c4ca6511 + nvme/DDR5… | 8192 | 196.4 ✓ | 7337.0 | — | src |
| DGX Spark x2 · 128 GB | DeepSeek-V4.1-Flash | EXL3 2.9bpw | exl3 v1.4.2 | 4000 | 154.0 ✓ | — | — | src |
| DGX Spark x2 · 128 GB | DeepSeek-V4.1-Flash | EXL3 2.7bpw (per-expert) | vllm upstream vLLM with 21 patches | 240000 | 141.0 ✓ | — | — | src |
| DGX Spark x2 · 128 GB | DeepSeek-V4.1-Flash | EXL3 2.9bpw | tensorfold bd0024d | 384 | 101.1 ✓ | — | — | src |
| DGX Spark x2 · 128 GB | DeepSeek-V4.1-Flash | EXL3 2.9bpw | tensorfold bd0024d | 128000 | 89.2 ✓ | — | — | src |
| DGX Spark x4 · 128 GB | DeepSeek-V4.1-Flash | EXL3 3.5bpw | vllm e47aa780b | 300000 | 82.0 ✓ | — | — | src |
| DGX Spark x2 · 128 GB | DeepSeek-V4.1-Flash | EXL3 2.9bpw | exl3 v1.4.2 | 2000 | 74.6 ✓ | — | — | src |
| DGX Spark x4 · 128 GB | DeepSeek-V4.1-Flash | EXL3 3.5bpw | vllm dsv41-feat commit e47aa780b | 300000 | 73.8 ✓ | — | — | src |
| DGX Spark x4 · 128 GB | DeepSeek-V4.1-Flash | FP4+FP8 native | vllm vllm nightly-8a728663 dsv41-feat ove… | 300000 | 73.8 ✓ | 1194.0 | — | src |
| DGX Spark · 128 GB | DeepSeek-V4.1-Flash | FP4 | custom v41_engine.py v0.1.0-wip (2026-09-10) | 32768 | 47.0 ✓ | — | — | src |
| DGX Spark x3 · 128 GB | DeepSeek-V4.1-Flash | EXL3 3.5bpw | vllm e47aa780b | 300000 | 46.0 ✓ | — | — | src |
| DGX Spark x2 · 128 GB | DeepSeek-V4.1-Flash | EXL3 2.9bpw | exl3 v1.4.2 | 1000 | 45.5 ✓ | — | — | src |
| DGX Spark x4 · 128 GB | DeepSeek-V4.1-Flash | MXFP4 | vllm DSpark (Checkpoint) | 300000 | 41.0 ✓ | — | — | src |
| DGX Spark x4 · 128 GB | DeepSeek-V4.1-Flash | MXFP4 | vllm e47aa780b | 300000 | 38.0 ✓ | 1194.0 | — | src |
| DGX Spark x2 · 128 GB | DeepSeek-V4.1-Flash | EXL3 2.9bpw | exl3 v1.4.2 | 67000 | 35.0 ✓ | — | — | src |
| DGX Spark x2 · 128 GB | DeepSeek-V4.1-Flash | EXL3 2.9bpw | exl3 v1.4.2 | 268000 | 32.6 ✓ | — | — | src |
| DGX Spark x2 · 128 GB | DeepSeek-V4.1-Flash | EXL3 2.9bpw | exl3 v1.4.2 | 17000 | 32.4 ✓ | — | — | src |
| DGX Spark x2 · 128 GB | DeepSeek-V4.1-Flash | EXL3 2.9bpw | exl3 v1.4.2 | 559000 | 30.5 ✓ | — | — | src |
| DGX Spark x4 · 128 GB | DeepSeek-V4.1-Flash | EXL3 | vllm vllm-exl3 | 1000000 | 30.2 ✓ | — | — | src |
| RTX 3090 · 24 GB | DeepSeek-V4.1-Flash | EXL3 3.0 bpw | vllm 0.13 (lazymio/vllm-backport, DeepSee… | 262144 | 26.0 ✓ | — | — | src |
| DGX Spark · 128 GB | DeepSeek-V4.1-Flash | FP4 | custom v41_engine.py v0.3.0-wip (3.3 addendum) | 32768 | 22.1 ✓ | — | — | src |
| DGX Spark · 128 GB | DeepSeek-V4.1-Flash | FP4 | custom v41_engine.py v0.3.0-wip (commit 94a96a6..) | 32768 | 20.9 ✓ | — | — | src |
| DGX Spark · 128 GB | DeepSeek-V4.1-Flash | FP4 | custom triton-based engine (v41_ bd24743..22bd9a8+ (v0.2.0-wip), then… | 32768 | 20.9 ✓ | — | — | src |
| DGX Spark · 128 GB | DeepSeek-V4.1-Flash | FP4 | custom v41_engine.py v0.3.0-wip (3.2 addendum) | 32768 | 20.9 ✓ | — | — | src |
| DGX Spark · 128 GB | DeepSeek-V4.1-Flash | FP4 | custom v41_engine.py v0.2.0-wip (commits bd24743..22bd9a8… | 8192 | 16.9 ✓ | — | — | src |
| DGX Spark · 128 GB | DeepSeek-V4.1-Flash | FP4 | custom v41_engine.py v0.2.0-wip (2.9 addendum) | 8192 | 16.9 ✓ | — | — | src |
| DGX Spark · 128 GB | DeepSeek-V4.1-Flash | FP4 | custom triton-based engine (v41_ 9f172fb (v0.2.0-wip addendum 2.6) | 8192 | 15.4 ✓ | — | — | src |
| DGX Spark · 128 GB | DeepSeek-V4.1-Flash | FP4 | custom v41_engine.py v0.2.0-wip (9f172fb) | 8192 | 15.4 ✓ | — | — | src |
| DGX Spark · 128 GB | DeepSeek-V4.1-Flash | FP4 | custom triton-based engine (v41_ 22bd9a8 (v0.2.0-wip baseline) | 8192 | 13.0 ✓ | — | — | src |
| DGX Spark · 128 GB | DeepSeek-V4.1-Flash | FP4 | custom v41_engine.py v0.2.0-wip (bd24743..22bd9a8+) | 8192 | 12.9 ✓ | — | — | src |
| DGX Spark · 128 GB | DeepSeek-V4.1-Flash | FP4 | custom v41_engine.py v0.1.0-wip | 32768 | 2.7 ✓ | — | — | src |