# Open models you can run locally

> OnPrem World · https://onpremworld.com/en/models · Last updated: 2026-10-14 · CC BY 4.0

Popular open-weight models with their size, licence and the memory they need at each quantization.

| Model | Developer | Parameters | Q4_K_M @ 8K | Licence |
|---|---|---|---|---|
| [Llama 3.1 8B Instruct](https://onpremworld.com/en/models/llama-3.1-8b.md) | Meta | 8B | 6.2 GiB | Llama 3.1 Community License |
| [Llama 3.2 3B Instruct](https://onpremworld.com/en/models/llama-3.2-3b.md) | Meta | 3.21B | 3.3 GiB | Llama 3.2 Community License |
| [Llama 3.3 70B Instruct](https://onpremworld.com/en/models/llama-3.3-70b.md) | Meta | 70B | 44.5 GiB | Llama 3.3 Community License |
| [Llama 4 Scout 17B-16E Instruct](https://onpremworld.com/en/models/llama-4-scout.md) | Meta | 109B (17B active) | 66.6 GiB | Llama 4 Community License |
| [Qwen3-8B](https://onpremworld.com/en/models/qwen3-8b.md) | Alibaba Qwen | 8.2B | 6.5 GiB | Apache-2.0 |
| [Qwen3-32B](https://onpremworld.com/en/models/qwen3-32b.md) | Alibaba Qwen | 32.8B | 21.9 GiB | Apache-2.0 |
| [Qwen3-30B-A3B (2507)](https://onpremworld.com/en/models/qwen3-30b-a3b.md) | Alibaba Qwen | 30.5B (3.3B active) | 19.3 GiB | Apache-2.0 |
| [Qwen3-Coder-30B-A3B-Instruct](https://onpremworld.com/en/models/qwen3-coder-30b-a3b.md) | Alibaba Qwen | 30.5B (3.3B active) | 19.3 GiB | Apache-2.0 |
| [Qwen3-Coder-Next (80B-A3B)](https://onpremworld.com/en/models/qwen3-coder-next.md) | Alibaba Qwen | 80B (3B active) | 48.1 GiB | Apache-2.0 |
| [Qwen3.5-9B](https://onpremworld.com/en/models/qwen3.5-9b.md) | Alibaba Qwen | 9B | 6.1 GiB | Apache-2.0 |
| [Qwen3.5-27B](https://onpremworld.com/en/models/qwen3.5-27b.md) | Alibaba Qwen | 27B | 17.0 GiB | Apache-2.0 |
| [Qwen3.5-35B-A3B](https://onpremworld.com/en/models/qwen3.5-35b-a3b.md) | Alibaba Qwen | 35B (3B active) | 21.4 GiB | Apache-2.0 |
| [Qwen3.5-122B-A10B](https://onpremworld.com/en/models/qwen3.5-122b-a10b.md) | Alibaba Qwen | 122B (10B active) | 73.0 GiB | Apache-2.0 |
| [Qwen3.6-27B](https://onpremworld.com/en/models/qwen3.6-27b.md) | Alibaba Qwen | 27B | 17.0 GiB | Apache-2.0 |
| [Qwen3.6-35B-A3B](https://onpremworld.com/en/models/qwen3.6-35b-a3b.md) | Alibaba Qwen | 35B (3B active) | 21.4 GiB | Apache-2.0 |
| [Qwen3.8-27B](https://onpremworld.com/en/models/qwen3.8-27b.md) | Alibaba Qwen | 27B | 17.0 GiB | Apache-2.0 |
| [Qwen3.8-Flash-Next](https://onpremworld.com/en/models/qwen3.8-flash-next.md) | Alibaba Qwen | 180B (6B active) | 107.4 GiB | Qwen Community License 1.0 (qwen-community-1.0) |
| [Gemma 3 12B IT](https://onpremworld.com/en/models/gemma-3-12b.md) | Google DeepMind | 12B | 8.4 GiB | Gemma Terms of Use |
| [Gemma 3 27B IT](https://onpremworld.com/en/models/gemma-3-27b.md) | Google DeepMind | 27B | 17.5 GiB | Gemma Terms of Use |
| [Gemma 4 E4B IT](https://onpremworld.com/en/models/gemma-4-e4b.md) | Google DeepMind | 8B | 5.5 GiB | Apache-2.0 |
| [Gemma 4 12B Unified IT](https://onpremworld.com/en/models/gemma-4-12b.md) | Google DeepMind | 11.95B | 8.0 GiB | Apache-2.0 |
| [Gemma 4 26B A4B IT](https://onpremworld.com/en/models/gemma-4-26b-a4b.md) | Google DeepMind | 25.2B (3.8B active) | 15.7 GiB | Apache-2.0 |
| [Gemma 4 31B IT](https://onpremworld.com/en/models/gemma-4-31b.md) | Google DeepMind | 30.7B | 19.8 GiB | Apache-2.0 |
| [Mistral Small 3.2 24B Instruct (2506)](https://onpremworld.com/en/models/mistral-small-3.2-24b.md) | Mistral AI | 24B | 16.0 GiB | Apache-2.0 |
| [Magistral Small 1.2 (2509)](https://onpremworld.com/en/models/magistral-small-2509.md) | Mistral AI | 24B | 16.0 GiB | Apache-2.0 |
| [Devstral Small 2 24B Instruct (2512)](https://onpremworld.com/en/models/devstral-small-2-24b.md) | Mistral AI | 24B | 16.0 GiB | Apache-2.0 |
| [Mistral Small 4 119B (2603)](https://onpremworld.com/en/models/mistral-small-4-119b.md) | Mistral AI | 119B (6.5B active) | 71.2 GiB | Apache-2.0 |
| [DeepSeek-R1-0528-Qwen3-8B](https://onpremworld.com/en/models/deepseek-r1-0528-qwen3-8b.md) | DeepSeek | 8.19B | 6.5 GiB | MIT |
| [DeepSeek-R1-Distill-Qwen-32B](https://onpremworld.com/en/models/deepseek-r1-distill-qwen-32b.md) | DeepSeek | 32.76B | 21.9 GiB | MIT |
| [DeepSeek-R1-0528 (671B)](https://onpremworld.com/en/models/deepseek-r1-0528.md) | DeepSeek | 671B (37B active) | 398.8 GiB | MIT |
| [DeepSeek-V4-Flash](https://onpremworld.com/en/models/deepseek-v4-flash.md) | DeepSeek | 284B (13B active) | 168.9 GiB | MIT |
| [gpt-oss-20b](https://onpremworld.com/en/models/gpt-oss-20b.md) | OpenAI | 21B (3.6B active) | 13.1 GiB | Apache-2.0 |
| [gpt-oss-120b](https://onpremworld.com/en/models/gpt-oss-120b.md) | OpenAI | 117B (5.1B active) | 70.1 GiB | Apache-2.0 |
| [Phi-4 (14B)](https://onpremworld.com/en/models/phi-4.md) | Microsoft | 14B | 10.4 GiB | MIT |
| [GLM-4.5-Air](https://onpremworld.com/en/models/glm-4.5-air.md) | Zhipu AI (Z.ai) | 106B (12B active) | 64.8 GiB | MIT |
| [GLM-4.7-Flash (30B-A3B)](https://onpremworld.com/en/models/glm-4.7-flash.md) | Zhipu AI (Z.ai) | 30B (3B active) | 18.7 GiB | MIT |
| [Kimi K2.6](https://onpremworld.com/en/models/kimi-k2.6.md) | Moonshot AI | 1000B (32B active) | 593.9 GiB | Modified MIT |