Qwen3.8-27B-Uncensored
4recorded runs
136.4best tok/s
4verified
What the Qwen3.8-27B-Uncensored numbers mean
The fastest verified result on our board is 136.4 output tok/s on an Intel Arc Pro B70 x2 at GPTQ-Int4 with a 2048-token context. That is about 7.3 ms per generated token — 500 tokens takes roughly 3.7 seconds. Prompt processing on the same record runs at 755.0 tok/s, so a 2,000-token prompt is read in about 2.6 seconds. Across the 4 records we hold for this model the range is 51.8–136.4 tok/s on 3 GPUs, because quantisation, context length and the engine build all move the number.
How much VRAM does Qwen3.8-27B-Uncensored need?
Qwen3.8-27B-Uncensored has 28.0B parameters. These estimates use the same formula as the VRAM calculator: weights, plus about 15% for a moderate-context KV cache and runtime overhead, plus a small engine floor.
| Quantisation | Estimated VRAM | Smallest card that fits |
|---|---|---|
| Q4_K_M (4-bit) | 18.9 GB | 24 GB |
| Q8_0 (8-bit) | 35.0 GB | 48 GB |
| FP16 (16-bit) | 65.2 GB | 80 GB |
Fastest GPUs for this model (best tok/s)
- Intel Arc Pro B70 x2136.4
- RTX 308074.1
- Radeon AI Pro R9700 x251.8
Models with a similar footprint
| Model | Params | Q4_K_M weights |
|---|---|---|
| Bonsai-27B | 28B | 15.8 GB |
| Godoter-27B | 28B | 15.8 GB |
| Huihui-Qwen3.8-27B-abliterated | 28B | 15.8 GB |
| Qwen3.5-27B | 28B | 15.8 GB |
| Qwen3.6-27B | 28B | 15.8 GB |
| Qwen3.6-27B-i1 | 28B | 15.8 GB |
| GPU | Model | Quant | Backend | Ctx | tok/s | prompt tok/s | VRAM GB | Source |
|---|---|---|---|---|---|---|---|---|
| Intel Arc Pro B70 x2 · 32 GB | Qwen3.8-27B-Uncensored | GPTQ-Int4 | vllm 0.27.2rc1.dev78+g8e6d8e4f6 XPU (cust… | 2048 | 136.4 ✓ | 755.0 | — | src |
| Intel Arc Pro B70 x2 · 32 GB | Qwen3.8-27B-Uncensored | GPTQ-Int4 | vllm vLLM 0.26.1rc1.dev771+g8e6d8e4f6 XPU… | 2048 | 105.6 ✓ | 710.3 | — | src |
| RTX 3080 · 10 GB | Qwen3.8-27B-Uncensored | IQ2_XXS | llama.cpp b10472 | 16384 | 74.1 ✓ | 1159.2 | 9.5 | src |
| Radeon AI Pro R9700 x2 · 32 GB | Qwen3.8-27B-Uncensored | Q8_0 | llama.cpp stew675 llama-cpp-rdna-boosts 12-set… | 262144 | 51.8 ✓ | 1470.6 | 44.6 | src |