OnPrem World地端世界

DeepSeek-R1-0528 (671B)

DeepSeek-R1-0528 (671B) by DeepSeek (671B parameters, MoE with 37B active per token). At Q4_K_M with an 8K context it needs about 398.8 GiB of memory. The full 671B DeepSeek-R1 (37B active per token): even at 4-bit it needs more memory than any single machine in our catalog.

Last updated: 2026-10-13

Model facts

DeveloperDeepSeek
Parameters671B (37B active, MoE)[src]
Native context131,072 tokens[src]
LicenceMIT[src]
Commercial useYes
KV cacheCompressed latent KV (MLA), 61 layers[src]
Released2025-05

Good for: reasoning · math · coding · Chinese

Run it

ollama run deepseek-r1:671b

Memory needed

Weights + KV cache + runtime overhead, in GiB. Lower quantization = less memory, slightly lower quality.

Quantization4K context8K context32K context
Q4_K_M398.6 GiB398.8 GiB400.4 GiB
Q5_K_M467.5 GiB467.7 GiB469.3 GiB
Q6_K541.3 GiB541.6 GiB543.2 GiB
Q8_0697.9 GiB698.2 GiB699.8 GiB
FP161313.1 GiB1313.4 GiB1315.0 GiB

Which hardware runs it

Best quantization that fits each device with a 8K context. Estimates, not benchmarks. See the methodology.

HardwareMemoryBest quanttok/s (est.)
GeForce RTX 3060 (12 GB)12 GBDoesn't fit–
GeForce RTX 309024 GBDoesn't fit–
GeForce RTX 4060 Ti 16GB16 GBDoesn't fit–
GeForce RTX 4080 SUPER16 GBDoesn't fit–
GeForce RTX 409024 GBDoesn't fit–
GeForce RTX 5060 Ti 16GB16 GBDoesn't fit–
GeForce RTX 507012 GBDoesn't fit–
GeForce RTX 5070 Ti16 GBDoesn't fit–
GeForce RTX 508016 GBDoesn't fit–
GeForce RTX 509032 GBDoesn't fit–
Radeon RX 7900 XT20 GBDoesn't fit–
Radeon RX 7900 XTX24 GBDoesn't fit–
Radeon RX 9060 XT 16GB16 GBDoesn't fit–
Radeon RX 9070 XT16 GBDoesn't fit–
Arc B58012 GBDoesn't fit–
RTX A600048 GBDoesn't fit–
RTX 6000 Ada Generation48 GBDoesn't fit–
RTX PRO 5000 72GB Blackwell72 GBDoesn't fit–
RTX PRO 6000 Blackwell Workstation Edition96 GBDoesn't fit–
Radeon AI PRO R970032 GBDoesn't fit–
Arc Pro B6024 GBDoesn't fit–
Arc Pro B7032 GBDoesn't fit–
M4 Pro64 GBDoesn't fit–
M4 Max (14-core CPU / 32-core GPU)36 GBDoesn't fit–
M4 Max (16-core CPU / 40-core GPU)128 GBDoesn't fit–
M3 Ultra512 GBDoesn't fit–
M532 GBDoesn't fit–
M5 Pro64 GBDoesn't fit–
M5 Max (18-core CPU / 32-core GPU)36 GBDoesn't fit–
M5 Max (18-core CPU / 40-core GPU)128 GBDoesn't fit–
M5 Ultra512 GBDoesn't fit–
M6 (16GB configuration, 153 GB/s)16 GBDoesn't fit–
M6 (24GB/32GB configurations, 170 GB/s)32 GBDoesn't fit–
DGX Spark128 GBDoesn't fit–
RTX Spark (N1X) laptops & compact desktops128 GBDoesn't fit–
Ryzen AI Max+ 395 (Strix Halo) systems128 GBDoesn't fit–
Ryzen AI Max+ PRO 495 (Gorgon Halo) systems192 GBDoesn't fit–

Frequently asked questions

How much VRAM does DeepSeek-R1-0528 (671B) need?

With an 8K context, about 398.8 GiB at Q4_K_M and 698.2 GiB at Q8_0 (weights + KV cache + runtime overhead). Longer contexts need more memory for the KV cache.

Can DeepSeek-R1-0528 (671B) run on an GeForce RTX 4090?

DeepSeek-R1-0528 (671B) does not fit on the GeForce RTX 4090 (24 GB), even at Q4_K_M with an 8K context.

Can I run DeepSeek-R1-0528 (671B) on a Mac?

DeepSeek-R1-0528 (671B) does not fit on the M3 Ultra (512 GB), even at Q4_K_M with an 8K context.

Can DeepSeek-R1-0528 (671B) be used commercially?

DeepSeek-R1-0528 (671B) is released under MIT. The licence allows commercial use (read its conditions).

Sources