DiggTop ⌕

Hy3

Hunyuan family · 299.0B params

1recorded run
27.6best tok/s
1verified

Evidence: 1 sourced run · 1 independent source · first recorded Sep 4, 2026. What these labels mean.

What the Hy3 numbers mean

The fastest verified result on our board is 27.6 output tok/s on an CMP 170HX x2 at Q2_K_XL with a 32768-token context. That is about 36.2 ms per generated token — 500 tokens takes roughly 18.1 seconds. Prompt processing on the same record runs at 250.7 tok/s, so a 2,000-token prompt is read in about 8.0 seconds. Peak VRAM was measured at 115.9 GB.

How much VRAM does Hy3 need?

Hy3 has 299.0B parameters. These estimates use the same formula as the VRAM calculator: weights, plus about 15% for a moderate-context KV cache and runtime overhead, plus a small engine floor.

QuantisationEstimated VRAMSmallest card that fits
Q4_K_M (4-bit)194.2 GBmulti-GPU or CPU offload
Q8_0 (8-bit)366.1 GBmulti-GPU or CPU offload
FP16 (16-bit)688.5 GBmulti-GPU or CPU offload

Long contexts and large batches raise the real number — read the smallest card as "possible with a reduced context". Measured throughput is on the benchmark board.

Fastest GPUs for this model (best tok/s)
  1. CMP 170HX x227.6

Models with a similar footprint

ModelParamsQ4_K_M weights
DeepSeek-V4-Flash-0731304B171.0 GB
DeepSeek-V4-Flash-0731-ROCmFP3304B171.0 GB
DeepSeek-V4-Flash-Vision-Exp305B171.6 GB
keys-DeepSeekV4Flash-Vision-EXP-ablit305B171.6 GB
DeepSeek-V4-Flash291B163.7 GB
GLM-5.3-Flash321B180.6 GB

Ranked by distance from Hy3's parameter count. Full benchmark board.

All benchmarks Methodology

GPUModelQuantBackendCtx tok/sprompt tok/sVRAM GBSource
CMP 170HX x2 · 64 GBHy3Q2_K_XLllama.cpp 0.28.03276827.6 ✓250.7115.9src
↑