RTX 5000
1recorded run
76.6best tok/s
1sourced
How it compares — 16 GB tier
RX 9070 XT545.3RX 6900 XT346.1RTX 500076.6RX 7800 XT42.0Tesla V100 PCIe 16GB40.7AMD RX 9060 XT 16GB39.8
All benchmarks Compare RTX 5000 →
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| RTX 5000 · 16 GB | VibeThinker-3B | Q8_0 | llama.cpp 9628 (c2ba3e47a) | 65536 | 76.6 ✓ | 1299.3 | 6.1 | src |