Compatibility Matrix
Best community run per VRAM tier for the most-run open-weight models. Cells show tok/s and quantization — the same model often lands in multiple tiers via different quants. Full board · Submit your run.
Model familyAllArceeBaichuanBTLCohereDeepseekDeepseek-CoderDeepseek-R1DeepSeek-V4.1-FlashGemmaGLMGptHunyuanKimiKwaipilotLagunaLFMLingLlamaMiniCPM-VMinimaxMistralMobileLLMMuseNemotronOrnithPhiQwenQwen3.8RNJSparkunknown
| Model | Family | <24GB | 24–48GB | >48GB | runs |
|---|---|---|---|---|---|
| Laguna-XS-2.1 | Laguna | — | 283.1 · Q5_K_M GGUF | — | 5 |
| Laguna-S-2.1 | Laguna | — | 125.5 · INT4_W4A16 | 63.3 · Q4_K_M | 3 |