OnPrem World地端世界

Radeon RX 9070 XT

AMD Radeon RX 9070 XT: 16 GB of memory at 640 GB/s. Below: the open models it can run, estimated at 16 GB with an 8K context. 16 GB of VRAM at 640 GB/s for $599 at launch, with FP8 support in RDNA 4; models up to about 24B fit at 4-bit.

Last updated: 2026-10-14

Specifications

Memory16 GB GDDR6[src]
Memory bandwidth640 GB/s[src]
Power304 W[src]
Launch2025-03[src]
Launch priceUS$599[src]
ArchitectureRDNA 4[src]
SoftwareROCm / Vulkan

What it can run

Best-quality quantization that fits with a 8K context, and the estimated generation speed. Estimates, not benchmarks. See the methodology.

ModelParamsBest quantMemorytok/s (est.)
Gemma 4 26B A4B IT25.2B (3.8B)Q4_K_M15.7 GiB194
Mistral Small 3.2 24B Instruct (2506)24BQ4_K_M16.0 GiB31
Magistral Small 1.2 (2509)24BQ4_K_M16.0 GiB31
Devstral Small 2 24B Instruct (2512)24BQ4_K_M16.0 GiB31
gpt-oss-20b21B (3.6B)Q5_K_M15.3 GiB175
Phi-4 (14B)14BQ6_K13.3 GiB39
Gemma 3 12B IT12BQ8_013.8 GiB35
Gemma 4 12B Unified IT11.95BQ8_013.3 GiB35
Qwen3.5-9B9BQ8_010.1 GiB47
Qwen3-8B8.2BQ8_010.1 GiB51
DeepSeek-R1-0528-Qwen3-8B8.19BQ8_010.1 GiB51
Llama 3.1 8B Instruct8BQ8_09.8 GiB53
Gemma 4 E4B IT8BQ8_09.1 GiB53
Llama 3.2 3B Instruct3.21BFP167.7 GiB70
Kimi K2.61000B (32B)Doesn't fit––
DeepSeek-R1-0528 (671B)671B (37B)Doesn't fit––
DeepSeek-V4-Flash284B (13B)Doesn't fit––
Qwen3.8-Flash-Next180B (6B)Doesn't fit––
Qwen3.5-122B-A10B122B (10B)Doesn't fit––
Mistral Small 4 119B (2603)119B (6.5B)Doesn't fit––
gpt-oss-120b117B (5.1B)Doesn't fit––
Llama 4 Scout 17B-16E Instruct109B (17B)Doesn't fit––
GLM-4.5-Air106B (12B)Doesn't fit––
Qwen3-Coder-Next (80B-A3B)80B (3B)Doesn't fit––
Llama 3.3 70B Instruct70BDoesn't fit––
Qwen3.5-35B-A3B35B (3B)Doesn't fit––
Qwen3.6-35B-A3B35B (3B)Doesn't fit––
Qwen3-32B32.8BDoesn't fit––
DeepSeek-R1-Distill-Qwen-32B32.76BDoesn't fit––
Gemma 4 31B IT30.7BDoesn't fit––
Qwen3-30B-A3B (2507)30.5B (3.3B)Doesn't fit––
Qwen3-Coder-30B-A3B-Instruct30.5B (3.3B)Doesn't fit––
GLM-4.7-Flash (30B-A3B)30B (3B)Doesn't fit––
Qwen3.5-27B27BDoesn't fit––
Qwen3.6-27B27BDoesn't fit––
Qwen3.8-27B27BDoesn't fit––
Gemma 3 27B IT27BDoesn't fit––

Prices

Latest price at each shop, as listed on the day we checked.

RegionShopListingPricePer GBChecked
Taiwan原價屋 CoolPC{華擎 RX9070XT Challenger 16GB}2970MHz/29cm/三風扇/註五年保Line on the shop's public price list (no per-product page); list stamped 2026/10/14 15:47NT$29,890NT$1,868/GB2026-10-14
Taiwan欣亞數位 Sinya撼訊 Reaper RX 9070 XT 16GB GDDR6 遊蕩者 (std:2970HMz/三風扇/三年保/MIT台灣製/長28.9cm)NT$30,990NT$1,937/GB2026-10-14
USNeweggASRock Challenger Radeon RX 9070 XT 16GB GDDR6 PCI Express 5.0 x16 Graphics Card RX9070XT CL 16GUS$879.99US$55/GB2026-10-14
  • Taiwan value: about 92.4 tok/s on Llama 3.1 8B Instruct (Q4_K_M, 8K), or 3.1 tok/s per NT$1,000.
  • US value: about 92.4 tok/s on Llama 3.1 8B Instruct (Q4_K_M, 8K), or 10.5 tok/s per US$100.

A price history chart appears once we have checked this device on two or more days.

All prices →

Frequently asked questions

Which LLMs can the Radeon RX 9070 XT run?

With 16 GB and an 8K context, the largest models that fit include: Gemma 4 26B A4B IT, Mistral Small 3.2 24B Instruct (2506), Magistral Small 1.2 (2509), Devstral Small 2 24B Instruct (2512), gpt-oss-20b. See the full table below.

How fast is the Radeon RX 9070 XT for local LLMs?

Generation speed is mostly set by memory bandwidth (640 GB/s). For Llama 3.1 8B Instruct at Q8_0, expect roughly 53 tokens/s; bigger models are slower.

Can the Radeon RX 9070 XT run 70B models?

Llama 3.3 70B Instruct does not fit on the Radeon RX 9070 XT (16 GB), even at Q4_K_M with an 8K context.

Sources