OnPrem World地端世界

M5 Ultra

Apple M5 Ultra: 96–512 GB of memory at 1200 GB/s. Below: the open models it can run, estimated at 512 GB with an 8K context. 1.2 TB/s and 96–512 GB of unified memory in the Mac Studio: 256 GB and up holds models like DeepSeek-V4-Flash that no single GPU here can. Apple says the 512 GB option ships in late October 2026.

Last updated: 2026-10-14

Specifications

Memory96–512 GB LPDDR5X[src]
Memory bandwidth1200 GB/s[src]
Launch2026-09[src]
Launch priceUS$5,499[src]
ArchitectureApple M5 Ultra (quad-die: two dual-die M5 Max joined by UltraFusion; 3 nm)[src]
SoftwareMetal / MLX

What it can run

Best-quality quantization that fits with a 8K context, and the estimated generation speed. Estimates, not benchmarks. See the methodology.

ModelParamsBest quantMemorytok/s (est.)
DeepSeek-V4-Flash284B (13B)Q8_0295.6 GiB56
Qwen3.8-Flash-Next180B (6B)FP16352.7 GiB65
Qwen3.5-122B-A10B122B (10B)FP16239.3 GiB39
Mistral Small 4 119B (2603)119B (6.5B)FP16233.4 GiB60
gpt-oss-120b117B (5.1B)FP16229.6 GiB76
Llama 4 Scout 17B-16E Instruct109B (17B)FP16215.2 GiB23
GLM-4.5-Air106B (12B)FP16209.2 GiB33
Qwen3-Coder-Next (80B-A3B)80B (3B)FP16157.1 GiB130
Llama 3.3 70B Instruct70BFP16139.9 GiB5.6
Qwen3.5-35B-A3B35B (3B)FP1669.1 GiB130
Qwen3.6-35B-A3B35B (3B)FP1669.1 GiB130
Qwen3-32B32.8BFP1666.6 GiB12
DeepSeek-R1-Distill-Qwen-32B32.76BFP1666.6 GiB12
Gemma 4 31B IT30.7BFP1661.6 GiB13
Qwen3-30B-A3B (2507)30.5B (3.3B)FP1660.9 GiB118
Qwen3-Coder-30B-A3B-Instruct30.5B (3.3B)FP1660.9 GiB118
GLM-4.7-Flash (30B-A3B)30B (3B)FP1659.6 GiB130
Qwen3.5-27B27BFP1653.8 GiB14
Qwen3.6-27B27BFP1653.8 GiB14
Qwen3.8-27B27BFP1653.8 GiB14
Gemma 3 27B IT27BFP1654.3 GiB14
Gemma 4 26B A4B IT25.2B (3.8B)FP1650.1 GiB103
Mistral Small 3.2 24B Instruct (2506)24BFP1648.7 GiB16
Magistral Small 1.2 (2509)24BFP1648.7 GiB16
Devstral Small 2 24B Instruct (2512)24BFP1648.7 GiB16
gpt-oss-20b21B (3.6B)FP1641.8 GiB108
Phi-4 (14B)14BFP1629.4 GiB28
Gemma 3 12B IT12BFP1624.8 GiB33
Gemma 4 12B Unified IT11.95BFP1624.2 GiB33
Qwen3.5-9B9BFP1618.4 GiB43
Qwen3-8B8.2BFP1617.7 GiB48
DeepSeek-R1-0528-Qwen3-8B8.19BFP1617.6 GiB48
Llama 3.1 8B Instruct8BFP1617.1 GiB49
Gemma 4 E4B IT8BFP1616.4 GiB49
Llama 3.2 3B Instruct3.21BFP167.7 GiB121
Kimi K2.61000B (32B)Doesn't fit––
DeepSeek-R1-0528 (671B)671B (37B)Doesn't fit––

Prices

Latest price at each shop, as listed on the day we checked.

RegionShopListingPricePer GBChecked
TaiwanAppleMac Studio,M5 Ultra 晶片,30 核心 CPU、64 核心 GPU,96GB 統一記憶體,1TB 儲存裝置Price shown in Apple Store configurator for this configurationNT$199,900NT$2,082/GB2026-10-14
USAppleMac Studio, M5 Ultra chip, 30-core CPU, 64-core GPU, 96GB memory, 1TB storagePrice shown in Apple Store configurator for this configurationUS$5,499US$57/GB2026-10-14
  • Taiwan value: about 160.8 tok/s on Llama 3.1 8B Instruct (Q4_K_M, 8K), or 0.8 tok/s per NT$1,000.
  • US value: about 160.8 tok/s on Llama 3.1 8B Instruct (Q4_K_M, 8K), or 2.9 tok/s per US$100.

A price history chart appears once we have checked this device on two or more days.

All prices →

Frequently asked questions

Which LLMs can the M5 Ultra run?

With 512 GB and an 8K context, the largest models that fit include: DeepSeek-V4-Flash, Qwen3.8-Flash-Next, Qwen3.5-122B-A10B, Mistral Small 4 119B (2603), gpt-oss-120b. See the full table below.

How fast is the M5 Ultra for local LLMs?

Generation speed is mostly set by memory bandwidth (1200 GB/s). For Llama 3.1 8B Instruct at FP16, expect roughly 49 tokens/s; bigger models are slower.

Can the M5 Ultra run 70B models?

Yes. Llama 3.3 70B Instruct fits on the M5 Ultra (512 GB) at FP16 with an 8K context, using about 139.9 GiB, at an estimated 5.6 tokens/s.

Sources