OnPrem World地端世界

M5

Apple M5: 16–32 GB of memory at 153 GB/s. Below: the open models it can run, estimated at 32 GB with an 8K context. The base M5 with 16–32 GB at 153 GB/s: fine for 8–14B models; 32 GB holds larger ones, but they run slowly.

Last updated: 2026-10-14

Specifications

Memory16–32 GB LPDDR5X[src]
Memory bandwidth153 GB/s[src]
Launch2025-10[src]
Launch priceUS$1,599[src]
ArchitectureApple M5 family (third-generation 3 nm; TSMC N3P)[src]
SoftwareMetal / MLX

What it can run

Best-quality quantization that fits with a 8K context, and the estimated generation speed. Estimates, not benchmarks. See the methodology.

ModelParamsBest quantMemorytok/s (est.)
Qwen3.5-35B-A3B35B (3B)Q4_K_M21.4 GiB55
Qwen3.6-35B-A3B35B (3B)Q4_K_M21.4 GiB55
Qwen3-32B32.8BQ4_K_M21.9 GiB5.0
DeepSeek-R1-Distill-Qwen-32B32.76BQ4_K_M21.9 GiB5.0
Gemma 4 31B IT30.7BQ5_K_M22.9 GiB4.6
Qwen3-30B-A3B (2507)30.5B (3.3B)Q5_K_M22.5 GiB42
Qwen3-Coder-30B-A3B-Instruct30.5B (3.3B)Q5_K_M22.5 GiB42
GLM-4.7-Flash (30B-A3B)30B (3B)Q5_K_M21.8 GiB47
Qwen3.5-27B27BQ6_K22.7 GiB4.5
Qwen3.6-27B27BQ6_K22.7 GiB4.5
Qwen3.8-27B27BQ6_K22.7 GiB4.5
Gemma 3 27B IT27BQ6_K23.3 GiB4.5
Gemma 4 26B A4B IT25.2B (3.8B)Q6_K21.1 GiB32
Mistral Small 3.2 24B Instruct (2506)24BQ6_K21.1 GiB5.0
Magistral Small 1.2 (2509)24BQ6_K21.1 GiB5.0
Devstral Small 2 24B Instruct (2512)24BQ6_K21.1 GiB5.0
gpt-oss-20b21B (3.6B)Q8_022.5 GiB26
Phi-4 (14B)14BQ8_016.6 GiB6.7
Gemma 3 12B IT12BQ8_013.8 GiB7.8
Gemma 4 12B Unified IT11.95BQ8_013.3 GiB7.8
Qwen3.5-9B9BFP1618.4 GiB5.5
Qwen3-8B8.2BFP1617.7 GiB6.1
DeepSeek-R1-0528-Qwen3-8B8.19BFP1617.6 GiB6.1
Llama 3.1 8B Instruct8BFP1617.1 GiB6.2
Gemma 4 E4B IT8BFP1616.4 GiB6.2
Llama 3.2 3B Instruct3.21BFP167.7 GiB15
Kimi K2.61000B (32B)Doesn't fit––
DeepSeek-R1-0528 (671B)671B (37B)Doesn't fit––
DeepSeek-V4-Flash284B (13B)Doesn't fit––
Qwen3.8-Flash-Next180B (6B)Doesn't fit––
Qwen3.5-122B-A10B122B (10B)Doesn't fit––
Mistral Small 4 119B (2603)119B (6.5B)Doesn't fit––
gpt-oss-120b117B (5.1B)Doesn't fit––
Llama 4 Scout 17B-16E Instruct109B (17B)Doesn't fit––
GLM-4.5-Air106B (12B)Doesn't fit––
Qwen3-Coder-Next (80B-A3B)80B (3B)Doesn't fit––
Llama 3.3 70B Instruct70BDoesn't fit––

Prices

No prices recorded for this device yet. All prices →

Frequently asked questions

Which LLMs can the M5 run?

With 32 GB and an 8K context, the largest models that fit include: Qwen3.5-35B-A3B, Qwen3.6-35B-A3B, Qwen3-32B, DeepSeek-R1-Distill-Qwen-32B, Gemma 4 31B IT. See the full table below.

How fast is the M5 for local LLMs?

Generation speed is mostly set by memory bandwidth (153 GB/s). For Llama 3.1 8B Instruct at FP16, expect roughly 6.2 tokens/s; bigger models are slower.

Can the M5 run 70B models?

Llama 3.3 70B Instruct does not fit on the M5 (32 GB), even at Q4_K_M with an 8K context.

Sources