RTX 2080
2recorded runs
22.9best tok/s
0sourced
How it compares — 8 GB tier
What fits on 8 GB — measured
| Model | Quant | Peak VRAM | Headroom |
|---|---|---|---|
| Ornith-1.5-9B | Q4_K_M | 6.8 GB | 1.2 GB |
| Qwen3.8-9B-Distill | Q4_K_M | 6.8 GB | 1.2 GB |
All benchmarks Compare RTX 2080 →
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| RTX 2080 · 8 GB | Ornith-1.5-9B | Q4_K_M | llama.cpp — | 131072 | 22.9 … | 292.6 | 6.8 | src |
| RTX 2080 · 8 GB | Qwen3.8-9B-Distill | Q4_K_M | llama.cpp — | 131072 | 22.9 … | 292.4 | 6.8 | src |