Tesla V100 x2

Nvidia · 32 GB VRAM

6recorded runs

96.1best tok/s

5sourced

How it compares — 32 GB per card · multi-GPU

Radeon AI Pro R9700 x3223.4 RTX 5090 x2195.6 Intel Arc Pro B70 x4161.9 Intel Arc Pro B70 x2136.4 Instinct MI100 x4132.4 Radeon AI Pro R9700 x2131.4

Best verified tok/s per GPU in this VRAM tier — compare any two like-for-like.

Evidence: 5 sourced runs · 1 awaiting review · 2 independent sources · first recorded Aug 21, 2026 · last recorded Sep 24, 2026. What these labels mean.

What fits on 32 GB — measured

Model	Quant	Peak VRAM	Headroom
Ornith-1.5-35B-A3B	Q4_K_M	25.2 GB	6.8 GB
Qwen3.8-27B	Q8_K_XL	24.0 GB	8.0 GB

Peak process memory recorded by the submitter on this card — evidence of what fit, not a guarantee. Plan with the VRAM calculator.

All benchmarks Compare Tesla V100 x2 →

GPU	Model	Quant	Backend	Ctx	tok/s	prompt tok/s	VRAM GB	Source
Tesla V100 x2 · 32 GB	Qwen3.8-Flash-Next	IQ3XXS	llama.cpp b11030-mix-5ff778e	4000	96.1 ✓	—	—	src
Tesla V100 x2 · 32 GB	Qwen3.8-Flash-Next	IQ3XXS	llama.cpp b11030-mix-5ff778e	512	87.5 ✓	—	—	src
Tesla V100 x2 · 32 GB	Qwen3.8-Flash-Next	IQ3XXS	llama.cpp b11030-mix-5ff778e	131000	80.9 ✓	—	—	src
Tesla V100 x2 · 32 GB	Ornith-1.5-35B-A3B	Q4_K_M	llama.cpp 0.1.0-dev (build 10434)	131072	65.0 ✓	305.0	25.2	src
Tesla V100 x2 · 32 GB	Qwen3.8-27B	Q8_K_XL	llama.cpp 9463	131702	24.0 ✓	1200.0	24.0	src
Tesla V100 x2 · 32 GB	Qwen3.8-27B-MTP	Q6_K	llama.cpp —	262144	38.3 …	282.1	—	src

Related reading: GPU buying guide · used GPUs · Value index · Street prices