RTX 5090 x2

Nvidia · 32 GB VRAM

1recorded run

195.6best tok/s

1sourced

How it compares — 32 GB per card · multi-GPU

Best verified tok/s per GPU in this VRAM tier — compare any two like-for-like.

Evidence: 1 sourced run · 1 independent source · first recorded Aug 25, 2026. What these labels mean.

GPU	Model	Quant	Backend	Ctx	tok/s	prompt tok/s	VRAM GB	Source
RTX 5090 x2 · 32 GB	Qwen3.8-27B	NVFP4	sglang 0.0.0.dev331+g0149f56e8 (main@0149f5…	262144	195.6 ✓	16851.3	57.2	src