Compatibility Matrix
Best community run per VRAM tier for the most-run open-weight models. Cells show tok/s and quantization — the same model often lands in multiple tiers via different quants. Full board · Submit your run.
Model familyAllArceeBaichuanBTLCohereDeepseekDeepseek-CoderDeepseek-R1DeepSeek-V4.1-FlashGemmaGLMGptHunyuanKimiKwaipilotLagunaLFMLingLlamaMiniCPM-VMinimaxMistralMobileLLMMuseNemotronOrnithPhiQwenQwen3.8RNJSparkunknown
| Model | Family | <24GB | 24–48GB | >48GB | runs |
|---|---|---|---|---|---|
| Ternary Bonsai 2 27B | Qwen3.8 | — | — | — | 2 |
| Underdog-Saluki-27B | Qwen3.8 | — | — | 22.6 · IQ2-mix | 1 |