H100 NVL x2
1recorded run
293.3best tok/s
0sourced
All benchmarks Compare H100 NVL x2 →
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| H100 NVL x2 · 94 GB | Qwen3.8-27B | FP8 | sglang — | 2048 | 293.3 … | 1080.5 | — | src |
All benchmarks Compare H100 NVL x2 →
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| H100 NVL x2 · 94 GB | Qwen3.8-27B | FP8 | sglang — | 2048 | 293.3 … | 1080.5 | — | src |