GTX 1060 x2
1recorded run
18.3best tok/s
1sourced
All benchmarks Compare GTX 1060 x2 →
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| GTX 1060 x2 · 6 GB | LFM2-8B-A1B | Q4_K_M | llama.cpp b9553 | 2048 | 18.3 ✓ | 13.5 | 1.1 | src |
All benchmarks Compare GTX 1060 x2 →
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| GTX 1060 x2 · 6 GB | LFM2-8B-A1B | Q4_K_M | llama.cpp b9553 | 2048 | 18.3 ✓ | 13.5 | 1.1 | src |