Compatibility Matrix
Best community run per VRAM tier for the most-run open-weight models. Cells show tok/s and quantization — the same model often lands in multiple tiers via different quants. Full board · Submit your run.
Model familyAllArceeBaichuanBTLCohereDeepseekDeepseek-CoderDeepseek-R1DeepSeek-V4.1-FlashGemmaGLMGptHunyuanKimiKwaipilotLagunaLFMLingLlamaMiniCPM-VMinimaxMistralMobileLLMMuseNemotronOrnithPhiQwenQwen3.8RNJSparkunknown
| Model | Family | <24GB | 24–48GB | >48GB | runs |
|---|---|---|---|---|---|
| North-Mini-Code-1.0 | Cohere | — | 258.4 · UD-Q6_K_XL | — | 1 |