OnPrem World地端世界

DGX Spark

NVIDIA DGX Spark: 64–128 GB of memory at 273 GB/s. Below: the open models it can run, estimated at 128 GB with an 8K context. A small CUDA Linux box with 128 GB of unified memory: it holds 120B-class models, but its 273 GB/s bandwidth limits generation speed. It launched at $3,999, and NVIDIA has since raised the price.

Last updated: 2026-10-14

Specifications

Memory64–128 GB LPDDR5X[src]
Memory bandwidth273 GB/s[src]
Power140 W[src]
Launch2025-10[src]
Launch priceUS$3,999[src]
ArchitectureGrace Blackwell (GB10: Blackwell GPU + 20-core Arm CPU)[src]
SoftwareCUDA

What it can run

Best-quality quantization that fits with a 8K context, and the estimated generation speed. Estimates, not benchmarks. See the methodology.

ModelParamsBest quantMemorytok/s (est.)
Qwen3.5-122B-A10B122B (10B)Q5_K_M85.5 GiB23
Mistral Small 4 119B (2603)119B (6.5B)Q5_K_M83.4 GiB35
gpt-oss-120b117B (5.1B)Q6_K95.0 GiB39
Llama 4 Scout 17B-16E Instruct109B (17B)Q6_K89.8 GiB12
GLM-4.5-Air106B (12B)Q6_K87.3 GiB17
Qwen3-Coder-Next (80B-A3B)80B (3B)Q8_083.8 GiB51
Llama 3.3 70B Instruct70BQ8_075.7 GiB2.2
Qwen3.5-35B-A3B35B (3B)FP1669.1 GiB27
Qwen3.6-35B-A3B35B (3B)FP1669.1 GiB27
Qwen3-32B32.8BFP1666.6 GiB2.5
DeepSeek-R1-Distill-Qwen-32B32.76BFP1666.6 GiB2.5
Gemma 4 31B IT30.7BFP1661.6 GiB2.7
Qwen3-30B-A3B (2507)30.5B (3.3B)FP1660.9 GiB25
Qwen3-Coder-30B-A3B-Instruct30.5B (3.3B)FP1660.9 GiB25
GLM-4.7-Flash (30B-A3B)30B (3B)FP1659.6 GiB27
Qwen3.5-27B27BFP1653.8 GiB3.0
Qwen3.6-27B27BFP1653.8 GiB3.0
Qwen3.8-27B27BFP1653.8 GiB3.0
Gemma 3 27B IT27BFP1654.3 GiB3.0
Gemma 4 26B A4B IT25.2B (3.8B)FP1650.1 GiB22
Mistral Small 3.2 24B Instruct (2506)24BFP1648.7 GiB3.4
Magistral Small 1.2 (2509)24BFP1648.7 GiB3.4
Devstral Small 2 24B Instruct (2512)24BFP1648.7 GiB3.4
gpt-oss-20b21B (3.6B)FP1641.8 GiB23
Phi-4 (14B)14BFP1629.4 GiB5.9
Gemma 3 12B IT12BFP1624.8 GiB6.8
Gemma 4 12B Unified IT11.95BFP1624.2 GiB6.9
Qwen3.5-9B9BFP1618.4 GiB9.1
Qwen3-8B8.2BFP1617.7 GiB10.0
DeepSeek-R1-0528-Qwen3-8B8.19BFP1617.6 GiB10
Llama 3.1 8B Instruct8BFP1617.1 GiB10
Gemma 4 E4B IT8BFP1616.4 GiB10
Llama 3.2 3B Instruct3.21BFP167.7 GiB26
Kimi K2.61000B (32B)Doesn't fit––
DeepSeek-R1-0528 (671B)671B (37B)Doesn't fit––
DeepSeek-V4-Flash284B (13B)Doesn't fit––
Qwen3.8-Flash-Next180B (6B)Doesn't fit––

Prices

Latest price at each shop, as listed on the day we checked.

RegionShopListingPricePer GBChecked
Taiwanmomo購物網摩天商城 store TP0002353【麗臺科技】Leadtek NVIDIA DGX Spark GB10 / 128G / Gen4 4TB SSD桌上型AI超級電腦Third-party store inside momo; the page does not name the sellerNT$197,899NT$1,546/GB2026-10-14
Taiwan原價屋 CoolPCNVIDIA DGX Spark GB10 / 128G / Gen4 4TB SSDLine on the shop's public price list (no per-product page); list stamped 2026/10/14 15:47NT$199,500NT$1,559/GB2026-10-14
USNVIDIA MarketplaceNVIDIA DGX Spark, 128GB unified memory, 4TB NVMeUS$6,950US$54/GB2026-10-14
  • Taiwan value: about 33.8 tok/s on Llama 3.1 8B Instruct (Q4_K_M, 8K), or 0.2 tok/s per NT$1,000.
  • US value: about 33.8 tok/s on Llama 3.1 8B Instruct (Q4_K_M, 8K), or 0.5 tok/s per US$100.

A price history chart appears once we have checked this device on two or more days.

All prices →

Frequently asked questions

Which LLMs can the DGX Spark run?

With 128 GB and an 8K context, the largest models that fit include: Qwen3.5-122B-A10B, Mistral Small 4 119B (2603), gpt-oss-120b, Llama 4 Scout 17B-16E Instruct, GLM-4.5-Air. See the full table below.

How fast is the DGX Spark for local LLMs?

Generation speed is mostly set by memory bandwidth (273 GB/s). For Llama 3.1 8B Instruct at FP16, expect roughly 10 tokens/s; bigger models are slower.

Can the DGX Spark run 70B models?

Yes. Llama 3.3 70B Instruct fits on the DGX Spark (128 GB) at Q8_0 with an 8K context, using about 75.7 GiB, at an estimated 2.2 tokens/s.

Sources