OnPrem World地端世界

Radeon RX 7900 XTX

AMD Radeon RX 7900 XTX: 24 GB of memory at 960 GB/s. Below: the open models it can run, estimated at 24 GB with an 8K context. 24 GB of VRAM at 960 GB/s for $999 at launch, $600 less than the RTX 4090: the AMD route to 32B models at 4-bit, using ROCm or Vulkan instead of CUDA.

Last updated: 2026-10-14

Specifications

Memory24 GB GDDR6[src]
Memory bandwidth960 GB/s[src]
Power355 W[src]
Launch2022-12[src]
Launch priceUS$999[src]
ArchitectureRDNA 3[src]
SoftwareROCm / Vulkan

What it can run

Best-quality quantization that fits with a 8K context, and the estimated generation speed. Estimates, not benchmarks. See the methodology.

ModelParamsBest quantMemorytok/s (est.)
Qwen3.5-35B-A3B35B (3B)Q4_K_M21.4 GiB369
Qwen3.6-35B-A3B35B (3B)Q4_K_M21.4 GiB369
Qwen3-32B32.8BQ4_K_M21.9 GiB34
DeepSeek-R1-Distill-Qwen-32B32.76BQ4_K_M21.9 GiB34
Gemma 4 31B IT30.7BQ5_K_M22.9 GiB31
Qwen3-30B-A3B (2507)30.5B (3.3B)Q5_K_M22.5 GiB286
Qwen3-Coder-30B-A3B-Instruct30.5B (3.3B)Q5_K_M22.5 GiB286
GLM-4.7-Flash (30B-A3B)30B (3B)Q5_K_M21.8 GiB315
Qwen3.5-27B27BQ6_K22.7 GiB30
Qwen3.6-27B27BQ6_K22.7 GiB30
Qwen3.8-27B27BQ6_K22.7 GiB30
Gemma 3 27B IT27BQ6_K23.3 GiB30
Gemma 4 26B A4B IT25.2B (3.8B)Q6_K21.1 GiB215
Mistral Small 3.2 24B Instruct (2506)24BQ6_K21.1 GiB34
Magistral Small 1.2 (2509)24BQ6_K21.1 GiB34
Devstral Small 2 24B Instruct (2512)24BQ6_K21.1 GiB34
gpt-oss-20b21B (3.6B)Q8_022.5 GiB176
Phi-4 (14B)14BQ8_016.6 GiB45
Gemma 3 12B IT12BQ8_013.8 GiB53
Gemma 4 12B Unified IT11.95BQ8_013.3 GiB53
Qwen3.5-9B9BFP1618.4 GiB37
Qwen3-8B8.2BFP1617.7 GiB41
DeepSeek-R1-0528-Qwen3-8B8.19BFP1617.6 GiB41
Llama 3.1 8B Instruct8BFP1617.1 GiB42
Gemma 4 E4B IT8BFP1616.4 GiB42
Llama 3.2 3B Instruct3.21BFP167.7 GiB105
Kimi K2.61000B (32B)Doesn't fit––
DeepSeek-R1-0528 (671B)671B (37B)Doesn't fit––
DeepSeek-V4-Flash284B (13B)Doesn't fit––
Qwen3.8-Flash-Next180B (6B)Doesn't fit––
Qwen3.5-122B-A10B122B (10B)Doesn't fit––
Mistral Small 4 119B (2603)119B (6.5B)Doesn't fit––
gpt-oss-120b117B (5.1B)Doesn't fit––
Llama 4 Scout 17B-16E Instruct109B (17B)Doesn't fit––
GLM-4.5-Air106B (12B)Doesn't fit––
Qwen3-Coder-Next (80B-A3B)80B (3B)Doesn't fit––
Llama 3.3 70B Instruct70BDoesn't fit––

Prices

Latest price at each shop, as listed on the day we checked.

RegionShopListingPricePer GBChecked
USNeweggroboshinePowerColor Hellhound Radeon RX 7900 XTX 24GB GDDR6 PCI Express 4.0 ATX Graphics Card RX7900XTX 24G-L/OCNewegg marketplace seller; ships from Hong KongUS$1,353.11US$56/GB2026-10-14
  • US value: about 138.6 tok/s on Llama 3.1 8B Instruct (Q4_K_M, 8K), or 10.2 tok/s per US$100.

A price history chart appears once we have checked this device on two or more days.

All prices →

Frequently asked questions

Which LLMs can the Radeon RX 7900 XTX run?

With 24 GB and an 8K context, the largest models that fit include: Qwen3.5-35B-A3B, Qwen3.6-35B-A3B, Qwen3-32B, DeepSeek-R1-Distill-Qwen-32B, Gemma 4 31B IT. See the full table below.

How fast is the Radeon RX 7900 XTX for local LLMs?

Generation speed is mostly set by memory bandwidth (960 GB/s). For Llama 3.1 8B Instruct at FP16, expect roughly 42 tokens/s; bigger models are slower.

Can the Radeon RX 7900 XTX run 70B models?

Llama 3.3 70B Instruct does not fit on the Radeon RX 7900 XTX (24 GB), even at Q4_K_M with an 8K context.

Sources