T4 x3
1recorded run
46.6best tok/s
0sourced
All benchmarks Compare T4 x3 →
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| T4 x3 · 48 GB | Qwen3.6-35B-A3B | INT4_W4A16 | vllm 0.28.0 | 200000 | 46.6 … | 353.7 | 38.5 | src |
All benchmarks Compare T4 x3 →
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| T4 x3 · 48 GB | Qwen3.6-35B-A3B | INT4_W4A16 | vllm 0.28.0 | 200000 | 46.6 … | 353.7 | 38.5 | src |