OnPrem World地端世界

RTX PRO 6000 Blackwell Workstation Edition

NVIDIA RTX PRO 6000 Blackwell Workstation Edition: 96 GB of memory at 1792 GB/s. Below: the open models it can run, estimated at 96 GB with an 8K context. 96 GB of VRAM at 1,792 GB/s on one card: 70B models fit at 8-bit, and 120B-class MoE models at 5- to 6-bit.

Last updated: 2026-10-14

Specifications

Memory96 GB GDDR7 (ECC)[src]
Memory bandwidth1792 GB/s[src]
Power600 W[src]
Launch2025-04[src]
Launch priceUS$8,565[src]
ArchitectureBlackwell (GB202)[src]
SoftwareCUDA

What it can run

Best-quality quantization that fits with a 8K context, and the estimated generation speed. Estimates, not benchmarks. See the methodology.

ModelParamsBest quantMemorytok/s (est.)
Qwen3.5-122B-A10B122B (10B)Q5_K_M85.5 GiB176
Mistral Small 4 119B (2603)119B (6.5B)Q5_K_M83.4 GiB271
gpt-oss-120b117B (5.1B)Q6_K95.0 GiB299
Llama 4 Scout 17B-16E Instruct109B (17B)Q6_K89.8 GiB90
GLM-4.5-Air106B (12B)Q6_K87.3 GiB127
Qwen3-Coder-Next (80B-A3B)80B (3B)Q8_083.8 GiB394
Llama 3.3 70B Instruct70BQ8_075.7 GiB17
Qwen3.5-35B-A3B35B (3B)FP1669.1 GiB209
Qwen3.6-35B-A3B35B (3B)FP1669.1 GiB209
Qwen3-32B32.8BFP1666.6 GiB19
DeepSeek-R1-Distill-Qwen-32B32.76BFP1666.6 GiB19
Gemma 4 31B IT30.7BFP1661.6 GiB20
Qwen3-30B-A3B (2507)30.5B (3.3B)FP1660.9 GiB190
Qwen3-Coder-30B-A3B-Instruct30.5B (3.3B)FP1660.9 GiB190
GLM-4.7-Flash (30B-A3B)30B (3B)FP1659.6 GiB209
Qwen3.5-27B27BFP1653.8 GiB23
Qwen3.6-27B27BFP1653.8 GiB23
Qwen3.8-27B27BFP1653.8 GiB23
Gemma 3 27B IT27BFP1654.3 GiB23
Gemma 4 26B A4B IT25.2B (3.8B)FP1650.1 GiB165
Mistral Small 3.2 24B Instruct (2506)24BFP1648.7 GiB26
Magistral Small 1.2 (2509)24BFP1648.7 GiB26
Devstral Small 2 24B Instruct (2512)24BFP1648.7 GiB26
gpt-oss-20b21B (3.6B)FP1641.8 GiB174
Phi-4 (14B)14BFP1629.4 GiB45
Gemma 3 12B IT12BFP1624.8 GiB52
Gemma 4 12B Unified IT11.95BFP1624.2 GiB52
Qwen3.5-9B9BFP1618.4 GiB70
Qwen3-8B8.2BFP1617.7 GiB76
DeepSeek-R1-0528-Qwen3-8B8.19BFP1617.6 GiB77
Llama 3.1 8B Instruct8BFP1617.1 GiB78
Gemma 4 E4B IT8BFP1616.4 GiB78
Llama 3.2 3B Instruct3.21BFP167.7 GiB195
Kimi K2.61000B (32B)Doesn't fit––
DeepSeek-R1-0528 (671B)671B (37B)Doesn't fit––
DeepSeek-V4-Flash284B (13B)Doesn't fit––
Qwen3.8-Flash-Next180B (6B)Doesn't fit––

Prices

Latest price at each shop, as listed on the day we checked.

RegionShopListingPricePer GBChecked
USNeweggNVIDIA RTX PRO 6000 Blackwell Workstation Edition, 96 GB GDDR7 with ECC, PCI Express 5.0 x16, OEM packageOEM package; $19.99 shipping not includedUS$17,999US$187/GB2026-10-14
  • US value: about 258.6 tok/s on Llama 3.1 8B Instruct (Q4_K_M, 8K), or 1.4 tok/s per US$100.

A price history chart appears once we have checked this device on two or more days.

All prices →

Frequently asked questions

Which LLMs can the RTX PRO 6000 Blackwell Workstation Edition run?

With 96 GB and an 8K context, the largest models that fit include: Qwen3.5-122B-A10B, Mistral Small 4 119B (2603), gpt-oss-120b, Llama 4 Scout 17B-16E Instruct, GLM-4.5-Air. See the full table below.

How fast is the RTX PRO 6000 Blackwell Workstation Edition for local LLMs?

Generation speed is mostly set by memory bandwidth (1792 GB/s). For Llama 3.1 8B Instruct at FP16, expect roughly 78 tokens/s; bigger models are slower.

Can the RTX PRO 6000 Blackwell Workstation Edition run 70B models?

Yes. Llama 3.3 70B Instruct fits on the RTX PRO 6000 Blackwell Workstation Edition (96 GB) at Q8_0 with an 8K context, using about 75.7 GiB, at an estimated 17 tokens/s.

Sources