OnPrem World地端世界

GeForce RTX 5070 Ti

NVIDIA GeForce RTX 5070 Ti: 16 GB of memory at 896 GB/s. Below: the open models it can run, estimated at 16 GB with an 8K context. 16 GB of GDDR7 with 93% of the RTX 5080's bandwidth for $250 less at launch ($749 vs $999): the same model sizes at nearly the same speed.

Last updated: 2026-10-16

Specifications

Memory16 GB GDDR7[src]
Memory bandwidth896 GB/s[src]
Power300 W[src]
Launch2025-02[src]
Launch priceUS$749[src]
ArchitectureBlackwell[src]
SoftwareCUDA

What it can run

Best-quality quantization that fits with a 8K context, and the estimated generation speed. Estimates, not benchmarks. See the methodology.

ModelParamsBest quantMemorytok/s (est.)
Gemma 4 26B A4B IT25.2B (3.8B)Q4_K_M15.7 GiB176
Mistral Small 3.2 24B Instruct (2506)24BQ4_K_M16.0 GiB40
Magistral Small 1.2 (2509)24BQ4_K_M16.0 GiB40
Devstral Small 2 24B Instruct (2512)24BQ4_K_M16.0 GiB40
gpt-oss-20b21B (3.6B)Q5_K_M15.3 GiB164
Phi-4 (14B)14BQ6_K13.3 GiB49
Gemma 3 12B IT12BQ8_013.8 GiB45
Gemma 4 12B Unified IT11.95BQ8_013.3 GiB45
Qwen3.5-9B9BQ8_010.1 GiB58
Qwen3-8B8.2BQ8_010.1 GiB63
DeepSeek-R1-0528-Qwen3-8B8.19BQ8_010.1 GiB63
Llama 3.1 8B Instruct8BQ8_09.8 GiB64
Gemma 4 E4B IT8BQ8_09.1 GiB64
Llama 3.2 3B Instruct3.21BFP167.7 GiB82
Kimi K2.61000B (32B)Doesn't fit––
DeepSeek-R1-0528 (671B)671B (37B)Doesn't fit––
DeepSeek-V4-Flash284B (13B)Doesn't fit––
Qwen3.8-Flash-Next180B (6B)Doesn't fit––
Qwen3.5-122B-A10B122B (10B)Doesn't fit––
Mistral Small 4 119B (2603)119B (6.5B)Doesn't fit––
gpt-oss-120b117B (5.1B)Doesn't fit––
Llama 4 Scout 17B-16E Instruct109B (17B)Doesn't fit––
GLM-4.5-Air106B (12B)Doesn't fit––
Qwen3-Coder-Next (80B-A3B)80B (3B)Doesn't fit––
Llama 3.3 70B Instruct70BDoesn't fit––
Qwen3.5-35B-A3B35B (3B)Doesn't fit––
Qwen3.6-35B-A3B35B (3B)Doesn't fit––
Qwen3-32B32.8BDoesn't fit––
DeepSeek-R1-Distill-Qwen-32B32.76BDoesn't fit––
Gemma 4 31B IT30.7BDoesn't fit––
Qwen3-30B-A3B (2507)30.5B (3.3B)Doesn't fit––
Qwen3-Coder-30B-A3B-Instruct30.5B (3.3B)Doesn't fit––
GLM-4.7-Flash (30B-A3B)30B (3B)Doesn't fit––
Qwen3.5-27B27BDoesn't fit––
Qwen3.6-27B27BDoesn't fit––
Qwen3.8-27B27BDoesn't fit––
Gemma 3 27B IT27BDoesn't fit––

Prices

Latest price at each shop, as listed on the day we checked.

RegionShopListingPricePer GBChecked
Taiwan原價屋 CoolPC{微星 RTX5070Ti 16G INSPIRE 3X OC}2497MHz/29cm/三風扇/註五年Line on the shop's public price list (no per-product page); list stamped 2026/10/14 15:47NT$45,990NT$2,874/GB2026-10-14
Taiwanmomo購物網摩天商城 store TP0002790【MSI 微星】RTX 5070 TI 16G SHADOW 3X OC 顯示卡Third-party store inside momo; the page does not name the sellerNT$46,990NT$2,937/GB2026-10-14
USNeweggGIGABYTE WindForce GeForce RTX 5070 Ti 16GB GDDR7 PCI Express 5.0 ATX Graphics Card GV-N507TWF3OC-16GDUS$1,169.99US$73/GB2026-10-14
  • Taiwan value: about 102.7 tok/s on Llama 3.1 8B Instruct (Q4_K_M, 8K), or 2.2 tok/s per NT$1,000.
  • US value: about 102.7 tok/s on Llama 3.1 8B Instruct (Q4_K_M, 8K), or 8.8 tok/s per US$100.

A price history chart appears once we have checked this device on two or more days.

All prices →

Frequently asked questions

Which LLMs can the GeForce RTX 5070 Ti run?

With 16 GB and an 8K context, the largest models that fit include: Gemma 4 26B A4B IT, Mistral Small 3.2 24B Instruct (2506), Magistral Small 1.2 (2509), Devstral Small 2 24B Instruct (2512), gpt-oss-20b. See the full table below.

How fast is the GeForce RTX 5070 Ti for local LLMs?

Generation speed is mostly set by memory bandwidth (896 GB/s). For Llama 3.1 8B Instruct at Q8_0, expect roughly 64 tokens/s; bigger models are slower.

Can the GeForce RTX 5070 Ti run 70B models?

Llama 3.3 70B Instruct does not fit on the GeForce RTX 5070 Ti (16 GB), even at Q4_K_M with an 8K context.

Sources