RTX 2060 Super

Nvidia · 8 GB VRAM

3recorded runs

97.1best tok/s

3sourced

How it compares — 8 GB tier

Best verified tok/s per GPU in this VRAM tier — compare any two like-for-like.

Evidence: 3 sourced runs · 1 independent source · first recorded Sep 2, 2026 · last recorded Sep 4, 2026. What these labels mean.

Model	Quant	Peak VRAM	Headroom
Qwen3.8-9B-Distill	Q6_K	6.7 GB	1.3 GB
Ornith-1.5-9B	Q4_K_M	5.4 GB	2.6 GB
Qwen3.8-4B-Distill	Q4_K_M	3.0 GB	5.0 GB

Peak process memory recorded by the submitter on this card — evidence of what fit, not a guarantee. Plan with the VRAM calculator.

GPU	Model	Quant	Backend	Ctx	tok/s	prompt tok/s	VRAM GB	Source
RTX 2060 Super · 8 GB	Qwen3.8-4B-Distill	Q4_K_M	llama.cpp b10449 (0d9ceae1e38291035605613ab41a…	8192	97.1 ✓	2145.7	3.0	src
RTX 2060 Super · 8 GB	Ornith-1.5-9B	Q4_K_M	llama.cpp b10449 (0d9ceae1e38291035605613ab41a…	8192	60.4 ✓	1360.1	5.4	src
RTX 2060 Super · 8 GB	Qwen3.8-9B-Distill	Q6_K	llama.cpp b10449 (0d9ceae1e38291035605613ab41a…	8192	46.4 ✓	1295.0	6.7	src