DiggTop ⌕

DeepSeek-V4.1-Flash

Deepseek family · 552.0B params

39recorded runs
231.6best tok/s
39verified

Evidence: 39 sourced runs · 1 independent source · first recorded Sep 10, 2026 · last recorded Oct 15, 2026. What these labels mean.

What the DeepSeek-V4.1-Flash numbers mean

The fastest verified result on our board is 231.6 output tok/s on an RTX PRO 6000 Blackwell x4 at FP4+FP8 native with a 65536-token context. That is about 4.3 ms per generated token — 500 tokens takes roughly 2.2 seconds. Prompt processing on the same record runs at 7346.3 tok/s, so a 2,000-token prompt is read in about 0.3 seconds. Across the 39 records we hold for this model the range is 2.7–231.6 tok/s on 6 GPUs, because quantisation, context length and the engine build all move the number.

How much VRAM does DeepSeek-V4.1-Flash need?

DeepSeek-V4.1-Flash has 552.0B parameters. These estimates use the same formula as the VRAM calculator: weights, plus about 15% for a moderate-context KV cache and runtime overhead, plus a small engine floor.

QuantisationEstimated VRAMSmallest card that fits
Q4_K_M (4-bit)357.9 GBmulti-GPU or CPU offload
Q8_0 (8-bit)675.3 GBmulti-GPU or CPU offload
FP16 (16-bit)1270.4 GBmulti-GPU or CPU offload

Long contexts and large batches raise the real number — read the smallest card as "possible with a reduced context". Measured throughput is on the benchmark board.

Fastest GPUs for this model (best tok/s)
  1. RTX PRO 6000 Blackwell x4231.6
  2. DGX Spark x2154.0
  3. DGX Spark x482.0
  4. DGX Spark47.0
  5. DGX Spark x346.0

Models with a similar footprint

ModelParamsQ4_K_M weights
DeepSeek-V4.1-Flash-1017552B310.5 GB
GLM-5.2753B423.6 GB
GLM-5.3-Flash321B180.6 GB
DeepSeek-V4-Flash-Vision-Exp305B171.6 GB
keys-DeepSeekV4Flash-Vision-EXP-ablit305B171.6 GB
DeepSeek-V4-Flash-0731304B171.0 GB

Ranked by distance from DeepSeek-V4.1-Flash's parameter count. Full benchmark board.

All benchmarks Methodology

GPUModelQuantBackendCtx tok/sprompt tok/sVRAM GBSource
RTX PRO 6000 Blackwell x4 · 384 GBDeepSeek-V4.1-FlashFP4+FP8 nativesglang lmsysorg/sglang c4ca6511 + nvme/DDR5…65536231.6 ✓7346.3—src
RTX PRO 6000 Blackwell x4 · 384 GBDeepSeek-V4.1-FlashFP4+FP8 nativesglang lmsysorg/sglang c4ca6511 + nvme/DDR5…2048226.8 ✓7010.3—src
RTX PRO 6000 Blackwell x4 · 384 GBDeepSeek-V4.1-FlashFP4+FP8 nativesglang lmsysorg/sglang c4ca6511 + nvme/DDR5…400000220.2 ✓6081.4—src
RTX PRO 6000 Blackwell x4 · 384 GBDeepSeek-V4.1-FlashFP4+FP8 nativesglang lmsysorg/sglang c4ca6511 + nvme/DDR5…500000212.4 ✓5844.5—src
RTX PRO 6000 Blackwell x4 · 384 GBDeepSeek-V4.1-FlashFP4+FP8 nativesglang lmsysorg/sglang c4ca6511 + nvme/DDR5…32768211.5 ✓7438.7—src
RTX PRO 6000 Blackwell x4 · 384 GBDeepSeek-V4.1-FlashFP4+FP8 nativesglang lmsysorg/sglang c4ca6511 + nvme/DDR5…131072203.3 ✓7064.6—src
RTX PRO 6000 Blackwell x4 · 384 GBDeepSeek-V4.1-FlashFP4+FP8 nativesglang lmsysorg/sglang c4ca6511 + nvme/DDR5…200000202.2 ✓6802.6—src
RTX PRO 6000 Blackwell x4 · 384 GBDeepSeek-V4.1-FlashFP4+FP8 nativesglang lmsysorg/sglang c4ca6511 + nvme/DDR5…512200.9 ✓1943.0—src
RTX PRO 6000 Blackwell x4 · 384 GBDeepSeek-V4.1-FlashFP4+FP8 nativesglang lmsysorg/sglang c4ca6511 + nvme/DDR5…8192196.4 ✓7337.0—src
DGX Spark x2 · 128 GBDeepSeek-V4.1-FlashEXL3 2.9bpwexl3 v1.4.24000154.0 ✓——src
DGX Spark x2 · 128 GBDeepSeek-V4.1-FlashEXL3 2.7bpw (per-expert)vllm upstream vLLM with 21 patches240000141.0 ✓——src
DGX Spark x2 · 128 GBDeepSeek-V4.1-FlashEXL3 2.9bpwtensorfold bd0024d384101.1 ✓——src
DGX Spark x2 · 128 GBDeepSeek-V4.1-FlashEXL3 2.9bpwtensorfold bd0024d12800089.2 ✓——src
DGX Spark x4 · 128 GBDeepSeek-V4.1-FlashEXL3 3.5bpwvllm e47aa780b30000082.0 ✓——src
DGX Spark x2 · 128 GBDeepSeek-V4.1-FlashEXL3 2.9bpwexl3 v1.4.2200074.6 ✓——src
DGX Spark x4 · 128 GBDeepSeek-V4.1-FlashEXL3 3.5bpwvllm dsv41-feat commit e47aa780b30000073.8 ✓——src
DGX Spark x4 · 128 GBDeepSeek-V4.1-FlashFP4+FP8 nativevllm vllm nightly-8a728663 dsv41-feat ove…30000073.8 ✓1194.0—src
DGX Spark · 128 GBDeepSeek-V4.1-FlashFP4custom v41_engine.py v0.1.0-wip (2026-09-10)3276847.0 ✓——src
DGX Spark x3 · 128 GBDeepSeek-V4.1-FlashEXL3 3.5bpwvllm e47aa780b30000046.0 ✓——src
DGX Spark x2 · 128 GBDeepSeek-V4.1-FlashEXL3 2.9bpwexl3 v1.4.2100045.5 ✓——src
DGX Spark x4 · 128 GBDeepSeek-V4.1-FlashMXFP4vllm DSpark (Checkpoint)30000041.0 ✓——src
DGX Spark x4 · 128 GBDeepSeek-V4.1-FlashMXFP4vllm e47aa780b30000038.0 ✓1194.0—src
DGX Spark x2 · 128 GBDeepSeek-V4.1-FlashEXL3 2.9bpwexl3 v1.4.26700035.0 ✓——src
DGX Spark x2 · 128 GBDeepSeek-V4.1-FlashEXL3 2.9bpwexl3 v1.4.226800032.6 ✓——src
DGX Spark x2 · 128 GBDeepSeek-V4.1-FlashEXL3 2.9bpwexl3 v1.4.21700032.4 ✓——src
DGX Spark x2 · 128 GBDeepSeek-V4.1-FlashEXL3 2.9bpwexl3 v1.4.255900030.5 ✓——src
DGX Spark x4 · 128 GBDeepSeek-V4.1-FlashEXL3vllm vllm-exl3100000030.2 ✓——src
RTX 3090 · 24 GBDeepSeek-V4.1-FlashEXL3 3.0 bpwvllm 0.13 (lazymio/vllm-backport, DeepSee…26214426.0 ✓——src
DGX Spark · 128 GBDeepSeek-V4.1-FlashFP4custom v41_engine.py v0.3.0-wip (3.3 addendum)3276822.1 ✓——src
DGX Spark · 128 GBDeepSeek-V4.1-FlashFP4custom v41_engine.py v0.3.0-wip (commit 94a96a6..)3276820.9 ✓——src
DGX Spark · 128 GBDeepSeek-V4.1-FlashFP4custom triton-based engine (v41_ bd24743..22bd9a8+ (v0.2.0-wip), then…3276820.9 ✓——src
DGX Spark · 128 GBDeepSeek-V4.1-FlashFP4custom v41_engine.py v0.3.0-wip (3.2 addendum)3276820.9 ✓——src
DGX Spark · 128 GBDeepSeek-V4.1-FlashFP4custom v41_engine.py v0.2.0-wip (commits bd24743..22bd9a8…819216.9 ✓——src
DGX Spark · 128 GBDeepSeek-V4.1-FlashFP4custom v41_engine.py v0.2.0-wip (2.9 addendum)819216.9 ✓——src
DGX Spark · 128 GBDeepSeek-V4.1-FlashFP4custom triton-based engine (v41_ 9f172fb (v0.2.0-wip addendum 2.6)819215.4 ✓——src
DGX Spark · 128 GBDeepSeek-V4.1-FlashFP4custom v41_engine.py v0.2.0-wip (9f172fb)819215.4 ✓——src
DGX Spark · 128 GBDeepSeek-V4.1-FlashFP4custom triton-based engine (v41_ 22bd9a8 (v0.2.0-wip baseline)819213.0 ✓——src
DGX Spark · 128 GBDeepSeek-V4.1-FlashFP4custom v41_engine.py v0.2.0-wip (bd24743..22bd9a8+)819212.9 ✓——src
DGX Spark · 128 GBDeepSeek-V4.1-FlashFP4custom v41_engine.py v0.1.0-wip327682.7 ✓——src
↑