OnPrem World地端世界

M6 (24GB/32GB configurations, 170 GB/s)

Apple M6 (24GB/32GB configurations, 170 GB/s): 24–32 GB of memory at 170 GB/s. Below: the open models it can run, estimated at 32 GB with an 8K context. The same M6 with 24 or 32 GB runs at 170 GB/s instead of 153 GB/s; 32 GB fits MoE models such as Qwen3.6-35B-A3B at 4-bit.

Last updated: 2026-10-14

Specifications

Memory24–32 GB[src]
Memory bandwidth170 GB/s[src]
Launch2026-09[src]
ArchitectureApple M6 (2 nm)[src]
SoftwareMetal / MLX

What it can run

Best-quality quantization that fits with a 8K context, and the estimated generation speed. Estimates, not benchmarks. See the methodology.

ModelParamsBest quantMemorytok/s (est.)
Qwen3.5-35B-A3B35B (3B)Q4_K_M21.4 GiB61
Qwen3.6-35B-A3B35B (3B)Q4_K_M21.4 GiB61
Qwen3-32B32.8BQ4_K_M21.9 GiB5.6
DeepSeek-R1-Distill-Qwen-32B32.76BQ4_K_M21.9 GiB5.6
Gemma 4 31B IT30.7BQ5_K_M22.9 GiB5.1
Qwen3-30B-A3B (2507)30.5B (3.3B)Q5_K_M22.5 GiB47
Qwen3-Coder-30B-A3B-Instruct30.5B (3.3B)Q5_K_M22.5 GiB47
GLM-4.7-Flash (30B-A3B)30B (3B)Q5_K_M21.8 GiB52
Qwen3.5-27B27BQ6_K22.7 GiB5.0
Qwen3.6-27B27BQ6_K22.7 GiB5.0
Qwen3.8-27B27BQ6_K22.7 GiB5.0
Gemma 3 27B IT27BQ6_K23.3 GiB5.0
Gemma 4 26B A4B IT25.2B (3.8B)Q6_K21.1 GiB35
Mistral Small 3.2 24B Instruct (2506)24BQ6_K21.1 GiB5.6
Magistral Small 1.2 (2509)24BQ6_K21.1 GiB5.6
Devstral Small 2 24B Instruct (2512)24BQ6_K21.1 GiB5.6
gpt-oss-20b21B (3.6B)Q8_022.5 GiB29
Phi-4 (14B)14BQ8_016.6 GiB7.4
Gemma 3 12B IT12BQ8_013.8 GiB8.7
Gemma 4 12B Unified IT11.95BQ8_013.3 GiB8.7
Qwen3.5-9B9BFP1618.4 GiB6.1
Qwen3-8B8.2BFP1617.7 GiB6.7
DeepSeek-R1-0528-Qwen3-8B8.19BFP1617.6 GiB6.7
Llama 3.1 8B Instruct8BFP1617.1 GiB6.9
Gemma 4 E4B IT8BFP1616.4 GiB6.9
Llama 3.2 3B Instruct3.21BFP167.7 GiB17
Kimi K2.61000B (32B)Doesn't fit––
DeepSeek-R1-0528 (671B)671B (37B)Doesn't fit––
DeepSeek-V4-Flash284B (13B)Doesn't fit––
Qwen3.8-Flash-Next180B (6B)Doesn't fit––
Qwen3.5-122B-A10B122B (10B)Doesn't fit––
Mistral Small 4 119B (2603)119B (6.5B)Doesn't fit––
gpt-oss-120b117B (5.1B)Doesn't fit––
Llama 4 Scout 17B-16E Instruct109B (17B)Doesn't fit––
GLM-4.5-Air106B (12B)Doesn't fit––
Qwen3-Coder-Next (80B-A3B)80B (3B)Doesn't fit––
Llama 3.3 70B Instruct70BDoesn't fit––

Prices

Latest price at each shop, as listed on the day we checked.

RegionShopListingPricePer GBChecked
TaiwanAppleMac mini,M6 晶片,12 核心 CPU,12 核心 GPU,24GB 記憶體,256GB 儲存裝置Price shown in Apple Store configurator for this configurationNT$36,900NT$1,538/GB2026-10-14
USAppleMac mini, M6 chip, 12-core CPU, 12-core GPU, 24GB memory, 256GB storagePrice shown in Apple Store configurator for this configurationUS$1,099US$46/GB2026-10-14
  • Taiwan value: about 22.8 tok/s on Llama 3.1 8B Instruct (Q4_K_M, 8K), or 0.6 tok/s per NT$1,000.
  • US value: about 22.8 tok/s on Llama 3.1 8B Instruct (Q4_K_M, 8K), or 2.1 tok/s per US$100.

A price history chart appears once we have checked this device on two or more days.

All prices →

Frequently asked questions

Which LLMs can the M6 (24GB/32GB configurations, 170 GB/s) run?

With 32 GB and an 8K context, the largest models that fit include: Qwen3.5-35B-A3B, Qwen3.6-35B-A3B, Qwen3-32B, DeepSeek-R1-Distill-Qwen-32B, Gemma 4 31B IT. See the full table below.

How fast is the M6 (24GB/32GB configurations, 170 GB/s) for local LLMs?

Generation speed is mostly set by memory bandwidth (170 GB/s). For Llama 3.1 8B Instruct at FP16, expect roughly 6.9 tokens/s; bigger models are slower.

Can the M6 (24GB/32GB configurations, 170 GB/s) run 70B models?

Llama 3.3 70B Instruct does not fit on the M6 (24GB/32GB configurations, 170 GB/s) (32 GB), even at Q4_K_M with an 8K context.

Sources