DiggTop ⌕

VibeThinker-3B

Qwen family · 3.0B params

1recorded run
76.6best tok/s
1verified

Evidence: 1 sourced run · 1 independent source · first recorded Jun 17, 2026. What these labels mean.

What the VibeThinker-3B numbers mean

The fastest verified result on our board is 76.6 output tok/s on an RTX 5000 at Q8_0 with a 65536-token context. That is about 13.1 ms per generated token — 500 tokens takes roughly 6.5 seconds. Prompt processing on the same record runs at 1299.3 tok/s, so a 2,000-token prompt is read in about 1.5 seconds. Peak VRAM was measured at 6.1 GB.

How much VRAM does VibeThinker-3B need?

VibeThinker-3B has 3.0B parameters. These estimates use the same formula as the VRAM calculator: weights, plus about 15% for a moderate-context KV cache and runtime overhead, plus a small engine floor.

QuantisationEstimated VRAMSmallest card that fits
Q4_K_M (4-bit)2.7 GB8 GB
Q8_0 (8-bit)4.5 GB8 GB
FP16 (16-bit)7.7 GB12 GB

Long contexts and large batches raise the real number — read the smallest card as "possible with a reduced context". Measured throughput is on the benchmark board.

Fastest GPUs for this model (best tok/s)
  1. RTX 500076.6

Models with a similar footprint

ModelParamsQ4_K_M weights
LFM2.5-2.6B3B1.7 GB
Llama-3.2-3B-Instruct3B1.7 GB
Ministral-3-3B-Instruct-25123B1.7 GB
OpenLLaMA-3B3B1.7 GB
gemma-3n-E4B-it-text4B2.2 GB
NVIDIA-Nemotron-3-Nano-4B4B2.2 GB

Ranked by distance from VibeThinker-3B's parameter count. Full benchmark board.

All benchmarks Methodology

GPUModelQuantBackendCtx tok/sprompt tok/sVRAM GBSource
RTX 5000 · 16 GBVibeThinker-3BQ8_0llama.cpp 9628 (c2ba3e47a)6553676.6 ✓1299.36.1src
↑