OnPrem World地端世界

RTX PRO 6000 Blackwell Max-Q Workstation Edition

NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition: 96 GB of memory at 1792 GB/s. Below: the open models it can run, estimated at 96 GB with an 8K context. The 300 W blower version of the RTX PRO 6000: the same 96 GB at 1,792 GB/s, built to stack two to four cards in one tower.

Last updated: 2026-10-16

Specifications

Memory96 GB GDDR7 (ECC)[src]
Memory bandwidth1792 GB/s[src]
Power300 W[src]
ArchitectureBlackwell (GB202)[src]
SoftwareCUDA

What it can run

Best-quality quantization that fits with a 8K context, and the estimated generation speed. Estimates, not benchmarks. See the methodology.

ModelParamsBest quantMemorytok/s (est.)
Qwen3.5-122B-A10B122B (10B)Q5_K_M85.5 GiB130
Mistral Small 4 119B (2603)119B (6.5B)Q5_K_M83.4 GiB176
gpt-oss-120b117B (5.1B)Q6_K95.0 GiB187
Llama 4 Scout 17B-16E Instruct109B (17B)Q6_K89.8 GiB76
GLM-4.5-Air106B (12B)Q6_K87.3 GiB101
Qwen3-Coder-Next (80B-A3B)80B (3B)Q8_083.8 GiB220
Llama 3.3 70B Instruct70BQ8_075.7 GiB16
Qwen3.5-35B-A3B35B (3B)FP1669.1 GiB147
Qwen3.6-35B-A3B35B (3B)FP1669.1 GiB147
Qwen3-32B32.8BFP1666.6 GiB18
DeepSeek-R1-Distill-Qwen-32B32.76BFP1666.6 GiB18
Gemma 4 31B IT30.7BFP1661.6 GiB20
Qwen3-30B-A3B (2507)30.5B (3.3B)FP1660.9 GiB138
Qwen3-Coder-30B-A3B-Instruct30.5B (3.3B)FP1660.9 GiB138
GLM-4.7-Flash (30B-A3B)30B (3B)FP1659.6 GiB147
Qwen3.5-27B27BFP1653.8 GiB22
Qwen3.6-27B27BFP1653.8 GiB22
Qwen3.8-27B27BFP1653.8 GiB22
Gemma 3 27B IT27BFP1654.3 GiB22
Gemma 4 26B A4B IT25.2B (3.8B)FP1650.1 GiB124
Mistral Small 3.2 24B Instruct (2506)24BFP1648.7 GiB25
Magistral Small 1.2 (2509)24BFP1648.7 GiB25
Devstral Small 2 24B Instruct (2512)24BFP1648.7 GiB25
gpt-oss-20b21B (3.6B)FP1641.8 GiB129
Phi-4 (14B)14BFP1629.4 GiB41
Gemma 3 12B IT12BFP1624.8 GiB47
Gemma 4 12B Unified IT11.95BFP1624.2 GiB47
Qwen3.5-9B9BFP1618.4 GiB61
Qwen3-8B8.2BFP1617.7 GiB66
DeepSeek-R1-0528-Qwen3-8B8.19BFP1617.6 GiB66
Llama 3.1 8B Instruct8BFP1617.1 GiB68
Gemma 4 E4B IT8BFP1616.4 GiB68
Llama 3.2 3B Instruct3.21BFP167.7 GiB140
Kimi K2.61000B (32B)Doesn't fit––
DeepSeek-R1-0528 (671B)671B (37B)Doesn't fit––
DeepSeek-V4-Flash284B (13B)Doesn't fit––
Qwen3.8-Flash-Next180B (6B)Doesn't fit––

Prices

Latest price at each shop, as listed on the day we checked.

RegionShopListingPricePer GBChecked
Taiwan原價屋 CoolPCLeadtek RTX PRO 6000 Blackwell Max-Q 96GBLine on the shop's public price list (no per-product page); list stamped 2026/10/15 9:31NT$575,000NT$5,990/GB2026-10-15
  • Taiwan value: about 170.5 tok/s on Llama 3.1 8B Instruct (Q4_K_M, 8K), or 0.3 tok/s per NT$1,000.

A price history chart appears once we have checked this device on two or more days.

All prices →

Frequently asked questions

Which LLMs can the RTX PRO 6000 Blackwell Max-Q Workstation Edition run?

With 96 GB and an 8K context, the largest models that fit include: Qwen3.5-122B-A10B, Mistral Small 4 119B (2603), gpt-oss-120b, Llama 4 Scout 17B-16E Instruct, GLM-4.5-Air. See the full table below.

How fast is the RTX PRO 6000 Blackwell Max-Q Workstation Edition for local LLMs?

Generation speed is mostly set by memory bandwidth (1792 GB/s). For Llama 3.1 8B Instruct at FP16, expect roughly 68 tokens/s; bigger models are slower.

Can the RTX PRO 6000 Blackwell Max-Q Workstation Edition run 70B models?

Yes. Llama 3.3 70B Instruct fits on the RTX PRO 6000 Blackwell Max-Q Workstation Edition (96 GB) at Q8_0 with an 8K context, using about 75.7 GiB, at an estimated 16 tokens/s.

Sources