OnPrem World地端世界

M5 Pro

Apple M5 Pro: 24–64 GB of memory at 307 GB/s. Below: the open models it can run, estimated at 64 GB with an 8K context. 24–64 GB of unified memory at 307 GB/s in the MacBook Pro and Mac mini; 48 GB holds 32B models at 6-bit.

Last updated: 2026-10-14

Specifications

Memory24–64 GB LPDDR5X[src]
Memory bandwidth307 GB/s[src]
Launch2026-03[src]
Launch priceUS$2,199[src]
ArchitectureApple M5 Pro (Fusion Architecture: two third-generation 3 nm dies)[src]
SoftwareMetal / MLX

What it can run

Best-quality quantization that fits with a 8K context, and the estimated generation speed. Estimates, not benchmarks. See the methodology.

ModelParamsBest quantMemorytok/s (est.)
Llama 3.3 70B Instruct70BQ4_K_M44.5 GiB4.7
Qwen3.5-35B-A3B35B (3B)Q8_037.0 GiB63
Qwen3.6-35B-A3B35B (3B)Q8_037.0 GiB63
Qwen3-32B32.8BQ8_036.6 GiB5.7
DeepSeek-R1-Distill-Qwen-32B32.76BQ8_036.5 GiB5.7
Gemma 4 31B IT30.7BQ8_033.5 GiB6.1
Qwen3-30B-A3B (2507)30.5B (3.3B)Q8_032.9 GiB57
Qwen3-Coder-30B-A3B-Instruct30.5B (3.3B)Q8_032.9 GiB57
GLM-4.7-Flash (30B-A3B)30B (3B)Q8_032.1 GiB63
Qwen3.5-27B27BQ8_029.1 GiB7.0
Qwen3.6-27B27BQ8_029.1 GiB7.0
Qwen3.8-27B27BQ8_029.1 GiB7.0
Gemma 3 27B IT27BQ8_029.6 GiB7.0
Gemma 4 26B A4B IT25.2B (3.8B)Q8_027.0 GiB49
Mistral Small 3.2 24B Instruct (2506)24BQ8_026.7 GiB7.8
Magistral Small 1.2 (2509)24BQ8_026.7 GiB7.8
Devstral Small 2 24B Instruct (2512)24BQ8_026.7 GiB7.8
gpt-oss-20b21B (3.6B)FP1641.8 GiB28
Phi-4 (14B)14BFP1629.4 GiB7.1
Gemma 3 12B IT12BFP1624.8 GiB8.3
Gemma 4 12B Unified IT11.95BFP1624.2 GiB8.3
Qwen3.5-9B9BFP1618.4 GiB11
Qwen3-8B8.2BFP1617.7 GiB12
DeepSeek-R1-0528-Qwen3-8B8.19BFP1617.6 GiB12
Llama 3.1 8B Instruct8BFP1617.1 GiB12
Gemma 4 E4B IT8BFP1616.4 GiB12
Llama 3.2 3B Instruct3.21BFP167.7 GiB31
Kimi K2.61000B (32B)Doesn't fit––
DeepSeek-R1-0528 (671B)671B (37B)Doesn't fit––
DeepSeek-V4-Flash284B (13B)Doesn't fit––
Qwen3.8-Flash-Next180B (6B)Doesn't fit––
Qwen3.5-122B-A10B122B (10B)Doesn't fit––
Mistral Small 4 119B (2603)119B (6.5B)Doesn't fit––
gpt-oss-120b117B (5.1B)Doesn't fit––
Llama 4 Scout 17B-16E Instruct109B (17B)Doesn't fit––
GLM-4.5-Air106B (12B)Doesn't fit––
Qwen3-Coder-Next (80B-A3B)80B (3B)Doesn't fit––

Prices

Latest price at each shop, as listed on the day we checked.

RegionShopListingPricePer GBChecked
TaiwanAppleMac mini,M5 Pro 晶片,15 核心 CPU,16 核心 GPU,24GB 記憶體,512GB 儲存裝置Price shown in Apple Store configurator for this configurationNT$59,900NT$2,496/GB2026-10-14
USAppleMac mini, M5 Pro chip, 15-core CPU, 16-core GPU, 24GB memory, 512GB storageUS$1,699US$71/GB2026-10-14
  • Taiwan value: about 41.1 tok/s on Llama 3.1 8B Instruct (Q4_K_M, 8K), or 0.7 tok/s per NT$1,000.
  • US value: about 41.1 tok/s on Llama 3.1 8B Instruct (Q4_K_M, 8K), or 2.4 tok/s per US$100.

A price history chart appears once we have checked this device on two or more days.

All prices →

Frequently asked questions

Which LLMs can the M5 Pro run?

With 64 GB and an 8K context, the largest models that fit include: Llama 3.3 70B Instruct, Qwen3.5-35B-A3B, Qwen3.6-35B-A3B, Qwen3-32B, DeepSeek-R1-Distill-Qwen-32B. See the full table below.

How fast is the M5 Pro for local LLMs?

Generation speed is mostly set by memory bandwidth (307 GB/s). For Llama 3.1 8B Instruct at FP16, expect roughly 12 tokens/s; bigger models are slower.

Can the M5 Pro run 70B models?

Yes. Llama 3.3 70B Instruct fits on the M5 Pro (64 GB) at Q4_K_M with an 8K context, using about 44.5 GiB, at an estimated 4.7 tokens/s.

Sources