RTX 3090 Ti
Nvidia · 24 GB VRAM
1recorded run
97.0best tok/s
1sourced
How it compares — 24 GB tier
Best verified tok/s per GPU in this VRAM tier — compare any two like-for-like.
Evidence: 1 sourced run · 1 independent source · first recorded Sep 4, 2026. What these labels mean.
All benchmarks Compare RTX 3090 Ti →
| GPU | Model | Quant | Backend | Ctx |
tok/s | prompt tok/s | VRAM GB | Source |
| RTX 3090 Ti · 24 GB | Qwen3.8-27B | IQ4_XS | llama.cpp custom | 204800 | 97.0 ✓ | 1471.0 | 17.3 | src |
Related reading: GPU buying guide · used GPUs · Value index · Street prices