OnPrem World地端世界

M4 Max (16-core CPU / 40-core GPU)

Apple M4 Max (16-core CPU / 40-core GPU): 48–128 GB of memory at 546 GB/s. Below: the open models it can run, estimated at 128 GB with an 8K context. Up to 128 GB of unified memory at 546 GB/s: a 128 GB MacBook Pro or Mac Studio runs 120B-class MoE models such as gpt-oss-120b.

Last updated: 2026-10-14

Specifications

Memory48–128 GB LPDDR5X[src]
Memory bandwidth546 GB/s[src]
Launch2024-11[src]
Launch priceUS$3,699[src]
ArchitectureApple M4 family (second-generation 3 nm; TSMC N3E)[src]
SoftwareMetal / MLX

What it can run

Best-quality quantization that fits with a 8K context, and the estimated generation speed. Estimates, not benchmarks. See the methodology.

ModelParamsBest quantMemorytok/s (est.)
Qwen3.5-122B-A10B122B (10B)Q5_K_M85.5 GiB50
Mistral Small 4 119B (2603)119B (6.5B)Q5_K_M83.4 GiB77
gpt-oss-120b117B (5.1B)Q6_K95.0 GiB84
Llama 4 Scout 17B-16E Instruct109B (17B)Q6_K89.8 GiB25
GLM-4.5-Air106B (12B)Q6_K87.3 GiB36
Qwen3-Coder-Next (80B-A3B)80B (3B)Q8_083.8 GiB111
Llama 3.3 70B Instruct70BQ8_075.7 GiB4.8
Qwen3.5-35B-A3B35B (3B)FP1669.1 GiB59
Qwen3.6-35B-A3B35B (3B)FP1669.1 GiB59
Qwen3-32B32.8BFP1666.6 GiB5.4
DeepSeek-R1-Distill-Qwen-32B32.76BFP1666.6 GiB5.4
Gemma 4 31B IT30.7BFP1661.6 GiB5.8
Qwen3-30B-A3B (2507)30.5B (3.3B)FP1660.9 GiB54
Qwen3-Coder-30B-A3B-Instruct30.5B (3.3B)FP1660.9 GiB54
GLM-4.7-Flash (30B-A3B)30B (3B)FP1659.6 GiB59
Qwen3.5-27B27BFP1653.8 GiB6.6
Qwen3.6-27B27BFP1653.8 GiB6.6
Qwen3.8-27B27BFP1653.8 GiB6.6
Gemma 3 27B IT27BFP1654.3 GiB6.6
Gemma 4 26B A4B IT25.2B (3.8B)FP1650.1 GiB47
Mistral Small 3.2 24B Instruct (2506)24BFP1648.7 GiB7.4
Magistral Small 1.2 (2509)24BFP1648.7 GiB7.4
Devstral Small 2 24B Instruct (2512)24BFP1648.7 GiB7.4
gpt-oss-20b21B (3.6B)FP1641.8 GiB49
Phi-4 (14B)14BFP1629.4 GiB13
Gemma 3 12B IT12BFP1624.8 GiB15
Gemma 4 12B Unified IT11.95BFP1624.2 GiB15
Qwen3.5-9B9BFP1618.4 GiB20
Qwen3-8B8.2BFP1617.7 GiB22
DeepSeek-R1-0528-Qwen3-8B8.19BFP1617.6 GiB22
Llama 3.1 8B Instruct8BFP1617.1 GiB22
Gemma 4 E4B IT8BFP1616.4 GiB22
Llama 3.2 3B Instruct3.21BFP167.7 GiB55
Kimi K2.61000B (32B)Doesn't fit––
DeepSeek-R1-0528 (671B)671B (37B)Doesn't fit––
DeepSeek-V4-Flash284B (13B)Doesn't fit––
Qwen3.8-Flash-Next180B (6B)Doesn't fit––

Prices

No prices recorded for this device yet. All prices →

Frequently asked questions

Which LLMs can the M4 Max (16-core CPU / 40-core GPU) run?

With 128 GB and an 8K context, the largest models that fit include: Qwen3.5-122B-A10B, Mistral Small 4 119B (2603), gpt-oss-120b, Llama 4 Scout 17B-16E Instruct, GLM-4.5-Air. See the full table below.

How fast is the M4 Max (16-core CPU / 40-core GPU) for local LLMs?

Generation speed is mostly set by memory bandwidth (546 GB/s). For Llama 3.1 8B Instruct at FP16, expect roughly 22 tokens/s; bigger models are slower.

Can the M4 Max (16-core CPU / 40-core GPU) run 70B models?

Yes. Llama 3.3 70B Instruct fits on the M4 Max (16-core CPU / 40-core GPU) (128 GB) at Q8_0 with an 8K context, using about 75.7 GiB, at an estimated 4.8 tokens/s.

Sources