Compatibility Matrix

Best community run per VRAM tier for the most-run open-weight models. Cells show tok/s and quantization — the same model often lands in multiple tiers via different quants. Full board · Submit your run.

Model familyAll Arcee Baichuan BTL Cohere Deepseek Deepseek-Coder Deepseek-R1 DeepSeek-V4.1-Flash Gemma GLM Gpt Hunyuan Kimi Kwaipilot Laguna LFM Ling Llama MiniCPM-V Minimax Mistral MobileLLM Muse Nemotron Ornith Phi Qwen Qwen3.8 RNJ Spark unknown

Model	Family	<24GB	24–48GB	>48GB	runs
Ling-3.0-tiny	Ling	52.6 · Q4_K_M	232.8 · Q8_0	369.1 · Q4_K_M	4
Ling-3.0-flash	Ling	—	39.3 · Q4_0_ROCMFP4_STRIX_LEAN	43.4 · AD-IQ4_XXS	2

6 runs · last run Sep 1, 2026. Filter by family above; full board for every row.

VRAM tiers: <24 GB · 24–48 GB · >48 GB. A cell shows the best single-stream tok/s and quant recorded in that tier — not a guarantee for every loadout. Imported rows carry their original methodology link.

Related guides: best GPU for Qwen3 · quantization · Strix Halo 128GB