OnPrem World地端世界

M5 Max (18-core CPU / 40-core GPU)

Apple M5 Max (18-core CPU / 40-core GPU): 48–128 GB of memory at 614 GB/s. Below: the open models it can run, estimated at 128 GB with an 8K context. Up to 128 GB of unified memory at 614 GB/s in the MacBook Pro and Mac Studio: 128 GB runs 120B-class MoE models such as gpt-oss-120b.

Last updated: 2026-10-14

Specifications

Memory48–128 GB LPDDR5X[src]
Memory bandwidth614 GB/s[src]
Launch2026-03[src]
Launch priceUS$4,099[src]
ArchitectureApple M5 Max (Fusion Architecture: two third-generation 3 nm dies)[src]
SoftwareMetal / MLX

What it can run

Best-quality quantization that fits with a 8K context, and the estimated generation speed. Estimates, not benchmarks. See the methodology.

ModelParamsBest quantMemorytok/s (est.)
Qwen3.5-122B-A10B122B (10B)Q5_K_M85.5 GiB56
Mistral Small 4 119B (2603)119B (6.5B)Q5_K_M83.4 GiB86
gpt-oss-120b117B (5.1B)Q6_K95.0 GiB95
Llama 4 Scout 17B-16E Instruct109B (17B)Q6_K89.8 GiB28
GLM-4.5-Air106B (12B)Q6_K87.3 GiB40
Qwen3-Coder-Next (80B-A3B)80B (3B)Q8_083.8 GiB125
Llama 3.3 70B Instruct70BQ8_075.7 GiB5.4
Qwen3.5-35B-A3B35B (3B)FP1669.1 GiB67
Qwen3.6-35B-A3B35B (3B)FP1669.1 GiB67
Qwen3-32B32.8BFP1666.6 GiB6.1
DeepSeek-R1-Distill-Qwen-32B32.76BFP1666.6 GiB6.1
Gemma 4 31B IT30.7BFP1661.6 GiB6.5
Qwen3-30B-A3B (2507)30.5B (3.3B)FP1660.9 GiB60
Qwen3-Coder-30B-A3B-Instruct30.5B (3.3B)FP1660.9 GiB60
GLM-4.7-Flash (30B-A3B)30B (3B)FP1659.6 GiB67
Qwen3.5-27B27BFP1653.8 GiB7.4
Qwen3.6-27B27BFP1653.8 GiB7.4
Qwen3.8-27B27BFP1653.8 GiB7.4
Gemma 3 27B IT27BFP1654.3 GiB7.4
Gemma 4 26B A4B IT25.2B (3.8B)FP1650.1 GiB53
Mistral Small 3.2 24B Instruct (2506)24BFP1648.7 GiB8.3
Magistral Small 1.2 (2509)24BFP1648.7 GiB8.3
Devstral Small 2 24B Instruct (2512)24BFP1648.7 GiB8.3
gpt-oss-20b21B (3.6B)FP1641.8 GiB55
Phi-4 (14B)14BFP1629.4 GiB14
Gemma 3 12B IT12BFP1624.8 GiB17
Gemma 4 12B Unified IT11.95BFP1624.2 GiB17
Qwen3.5-9B9BFP1618.4 GiB22
Qwen3-8B8.2BFP1617.7 GiB24
DeepSeek-R1-0528-Qwen3-8B8.19BFP1617.6 GiB24
Llama 3.1 8B Instruct8BFP1617.1 GiB25
Gemma 4 E4B IT8BFP1616.4 GiB25
Llama 3.2 3B Instruct3.21BFP167.7 GiB62
Kimi K2.61000B (32B)Doesn't fit––
DeepSeek-R1-0528 (671B)671B (37B)Doesn't fit––
DeepSeek-V4-Flash284B (13B)Doesn't fit––
Qwen3.8-Flash-Next180B (6B)Doesn't fit––

Prices

Latest price at each shop, as listed on the day we checked.

RegionShopListingPricePer GBChecked
TaiwanAppleMac Studio,M5 Max 晶片,18 核心 CPU、40 核心 GPU,48GB 統一記憶體,512GB 儲存裝置Price shown in Apple Store configurator for this configurationNT$105,900NT$2,206/GB2026-10-14
USAppleMac Studio, M5 Max chip, 18-core CPU, 40-core GPU, 48GB memory, 512GB storagePrice shown in Apple Store configurator for this configurationUS$3,099US$65/GB2026-10-14
  • Taiwan value: about 82.3 tok/s on Llama 3.1 8B Instruct (Q4_K_M, 8K), or 0.8 tok/s per NT$1,000.
  • US value: about 82.3 tok/s on Llama 3.1 8B Instruct (Q4_K_M, 8K), or 2.7 tok/s per US$100.

A price history chart appears once we have checked this device on two or more days.

All prices →

Frequently asked questions

Which LLMs can the M5 Max (18-core CPU / 40-core GPU) run?

With 128 GB and an 8K context, the largest models that fit include: Qwen3.5-122B-A10B, Mistral Small 4 119B (2603), gpt-oss-120b, Llama 4 Scout 17B-16E Instruct, GLM-4.5-Air. See the full table below.

How fast is the M5 Max (18-core CPU / 40-core GPU) for local LLMs?

Generation speed is mostly set by memory bandwidth (614 GB/s). For Llama 3.1 8B Instruct at FP16, expect roughly 25 tokens/s; bigger models are slower.

Can the M5 Max (18-core CPU / 40-core GPU) run 70B models?

Yes. Llama 3.3 70B Instruct fits on the M5 Max (18-core CPU / 40-core GPU) (128 GB) at Q8_0 with an 8K context, using about 75.7 GiB, at an estimated 5.4 tokens/s.

Sources