Tesla V100

Nvidia · 32 GB VRAM

1recorded run

4.3best tok/s

1sourced

How it compares — 32 GB tier

Best verified tok/s per GPU in this VRAM tier — compare any two like-for-like.

Evidence: 1 sourced run · 1 independent source · first recorded Aug 5, 2026. What these labels mean.

GPU	Model	Quant	Backend	Ctx	tok/s	prompt tok/s	VRAM GB	Source
Tesla V100 · 32 GB	Qwen3.6-35B-A3B	Q4_K_M	llama.cpp e031d95	262144	4.3 ✓	322.5	28.9	src