GTX 1080 Ti
1recorded run
94.9best tok/s
1sourced
All benchmarks Compare GTX 1080 Ti →
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| GTX 1080 Ti · 11 GB | Ministral-3-3B-Instruct-2512 | Q4_K_M | llama.cpp 9789512 | 8192 | 94.9 ✓ | — | 5.3 | src |
All benchmarks Compare GTX 1080 Ti →
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| GTX 1080 Ti · 11 GB | Ministral-3-3B-Instruct-2512 | Q4_K_M | llama.cpp 9789512 | 8192 | 94.9 ✓ | — | 5.3 | src |