OnPrem World地端世界

M3 Ultra

Apple M3 Ultra: 96–512 GB of memory at 819 GB/s. Below: the open models it can run, estimated at 512 GB with an 8K context. 819 GB/s and 96–256 GB of unified memory in the Mac Studio (512 GB at launch, since dropped); 256 GB holds 280B-class MoE models like DeepSeek-V4-Flash at 4-bit.

Last updated: 2026-10-14

Specifications

Memory96–512 GB LPDDR5[src]
Memory bandwidth819 GB/s[src]
Launch2025-03[src]
Launch priceUS$3,999[src]
ArchitectureApple M3 family (3 nm; TSMC N3B), two M3 Max dies joined by UltraFusion[src]
SoftwareMetal / MLX

What it can run

Best-quality quantization that fits with a 8K context, and the estimated generation speed. Estimates, not benchmarks. See the methodology.

ModelParamsBest quantMemorytok/s (est.)
DeepSeek-V4-Flash284B (13B)Q8_0295.6 GiB39
Qwen3.8-Flash-Next180B (6B)FP16352.7 GiB44
Qwen3.5-122B-A10B122B (10B)FP16239.3 GiB27
Mistral Small 4 119B (2603)119B (6.5B)FP16233.4 GiB41
gpt-oss-120b117B (5.1B)FP16229.6 GiB52
Llama 4 Scout 17B-16E Instruct109B (17B)FP16215.2 GiB16
GLM-4.5-Air106B (12B)FP16209.2 GiB22
Qwen3-Coder-Next (80B-A3B)80B (3B)FP16157.1 GiB89
Llama 3.3 70B Instruct70BFP16139.9 GiB3.8
Qwen3.5-35B-A3B35B (3B)FP1669.1 GiB89
Qwen3.6-35B-A3B35B (3B)FP1669.1 GiB89
Qwen3-32B32.8BFP1666.6 GiB8.1
DeepSeek-R1-Distill-Qwen-32B32.76BFP1666.6 GiB8.1
Gemma 4 31B IT30.7BFP1661.6 GiB8.7
Qwen3-30B-A3B (2507)30.5B (3.3B)FP1660.9 GiB81
Qwen3-Coder-30B-A3B-Instruct30.5B (3.3B)FP1660.9 GiB81
GLM-4.7-Flash (30B-A3B)30B (3B)FP1659.6 GiB89
Qwen3.5-27B27BFP1653.8 GiB9.9
Qwen3.6-27B27BFP1653.8 GiB9.9
Qwen3.8-27B27BFP1653.8 GiB9.9
Gemma 3 27B IT27BFP1654.3 GiB9.9
Gemma 4 26B A4B IT25.2B (3.8B)FP1650.1 GiB70
Mistral Small 3.2 24B Instruct (2506)24BFP1648.7 GiB11
Magistral Small 1.2 (2509)24BFP1648.7 GiB11
Devstral Small 2 24B Instruct (2512)24BFP1648.7 GiB11
gpt-oss-20b21B (3.6B)FP1641.8 GiB74
Phi-4 (14B)14BFP1629.4 GiB19
Gemma 3 12B IT12BFP1624.8 GiB22
Gemma 4 12B Unified IT11.95BFP1624.2 GiB22
Qwen3.5-9B9BFP1618.4 GiB30
Qwen3-8B8.2BFP1617.7 GiB32
DeepSeek-R1-0528-Qwen3-8B8.19BFP1617.6 GiB33
Llama 3.1 8B Instruct8BFP1617.1 GiB33
Gemma 4 E4B IT8BFP1616.4 GiB33
Llama 3.2 3B Instruct3.21BFP167.7 GiB83
Kimi K2.61000B (32B)Doesn't fit––
DeepSeek-R1-0528 (671B)671B (37B)Doesn't fit––

Prices

No prices recorded for this device yet. All prices →

Frequently asked questions

Which LLMs can the M3 Ultra run?

With 512 GB and an 8K context, the largest models that fit include: DeepSeek-V4-Flash, Qwen3.8-Flash-Next, Qwen3.5-122B-A10B, Mistral Small 4 119B (2603), gpt-oss-120b. See the full table below.

How fast is the M3 Ultra for local LLMs?

Generation speed is mostly set by memory bandwidth (819 GB/s). For Llama 3.1 8B Instruct at FP16, expect roughly 33 tokens/s; bigger models are slower.

Can the M3 Ultra run 70B models?

Yes. Llama 3.3 70B Instruct fits on the M3 Ultra (512 GB) at FP16 with an 8K context, using about 139.9 GiB, at an estimated 3.8 tokens/s.

Sources