GeForce RTX 5060 Ti 16GB
NVIDIA GeForce RTX 5060 Ti 16GB: 16 GB of memory at 448 GB/s. Below: the open models it can run, estimated at 16 GB with an 8K context. 16 GB of GDDR7 for $429 at launch, with 56% more bandwidth than the RTX 4060 Ti 16GB (448 vs 288 GB/s): an affordable way to run models up to about 24B at 4-bit.
Last updated: 2026-10-14
Specifications
What it can run
Best-quality quantization that fits with a 8K context, and the estimated generation speed. Estimates, not benchmarks. See the methodology.
| Model | Params | Best quant | Memory | tok/s (est.) |
|---|---|---|---|---|
| Gemma 4 26B A4B IT | 25.2B (3.8B) | Q4_K_M | 15.7 GiB | 136 |
| Mistral Small 3.2 24B Instruct (2506) | 24B | Q4_K_M | 16.0 GiB | 22 |
| Magistral Small 1.2 (2509) | 24B | Q4_K_M | 16.0 GiB | 22 |
| Devstral Small 2 24B Instruct (2512) | 24B | Q4_K_M | 16.0 GiB | 22 |
| gpt-oss-20b | 21B (3.6B) | Q5_K_M | 15.3 GiB | 122 |
| Phi-4 (14B) | 14B | Q6_K | 13.3 GiB | 27 |
| Gemma 3 12B IT | 12B | Q8_0 | 13.8 GiB | 25 |
| Gemma 4 12B Unified IT | 11.95B | Q8_0 | 13.3 GiB | 25 |
| Qwen3.5-9B | 9B | Q8_0 | 10.1 GiB | 33 |
| Qwen3-8B | 8.2B | Q8_0 | 10.1 GiB | 36 |
| DeepSeek-R1-0528-Qwen3-8B | 8.19B | Q8_0 | 10.1 GiB | 36 |
| Llama 3.1 8B Instruct | 8B | Q8_0 | 9.8 GiB | 37 |
| Gemma 4 E4B IT | 8B | Q8_0 | 9.1 GiB | 37 |
| Llama 3.2 3B Instruct | 3.21B | FP16 | 7.7 GiB | 49 |
| Kimi K2.6 | 1000B (32B) | Doesn't fit | – | – |
| DeepSeek-R1-0528 (671B) | 671B (37B) | Doesn't fit | – | – |
| DeepSeek-V4-Flash | 284B (13B) | Doesn't fit | – | – |
| Qwen3.8-Flash-Next | 180B (6B) | Doesn't fit | – | – |
| Qwen3.5-122B-A10B | 122B (10B) | Doesn't fit | – | – |
| Mistral Small 4 119B (2603) | 119B (6.5B) | Doesn't fit | – | – |
| gpt-oss-120b | 117B (5.1B) | Doesn't fit | – | – |
| Llama 4 Scout 17B-16E Instruct | 109B (17B) | Doesn't fit | – | – |
| GLM-4.5-Air | 106B (12B) | Doesn't fit | – | – |
| Qwen3-Coder-Next (80B-A3B) | 80B (3B) | Doesn't fit | – | – |
| Llama 3.3 70B Instruct | 70B | Doesn't fit | – | – |
| Qwen3.5-35B-A3B | 35B (3B) | Doesn't fit | – | – |
| Qwen3.6-35B-A3B | 35B (3B) | Doesn't fit | – | – |
| Qwen3-32B | 32.8B | Doesn't fit | – | – |
| DeepSeek-R1-Distill-Qwen-32B | 32.76B | Doesn't fit | – | – |
| Gemma 4 31B IT | 30.7B | Doesn't fit | – | – |
| Qwen3-30B-A3B (2507) | 30.5B (3.3B) | Doesn't fit | – | – |
| Qwen3-Coder-30B-A3B-Instruct | 30.5B (3.3B) | Doesn't fit | – | – |
| GLM-4.7-Flash (30B-A3B) | 30B (3B) | Doesn't fit | – | – |
| Qwen3.5-27B | 27B | Doesn't fit | – | – |
| Qwen3.6-27B | 27B | Doesn't fit | – | – |
| Qwen3.8-27B | 27B | Doesn't fit | – | – |
| Gemma 3 27B IT | 27B | Doesn't fit | – | – |
Prices
Latest price at each shop, as listed on the day we checked.
| Region | Shop | Listing | Price | Per GB | Checked |
|---|---|---|---|---|---|
| Taiwan | 原價屋 CoolPC | ｛INNO3D RTX5060Ti 16GB TWIN X2｝2572MHz/25cm/註四年/雙風扇Line on the shop's public price list (no per-product page); list stamped 2026/10/14 15:47 | NT$24,488 | NT$1,531/GB | 2026-10-14 |
| Taiwan | momo購物網欣亞數位 SINYA | 【SINYA 欣亞數位】PNY RTX 5060 Ti 16G OC/std:2692MHz/雙風扇/獨家五年保Third-party store inside momo | NT$25,090 | NT$1,568/GB | 2026-10-14 |
| US | Newegg | MSI Ventus GeForce RTX 5060 Ti 16GB GDDR7 PCI Express 5.0 x16 (use x8) Graphics Card (RTX 5060 Ti 16G VENTUS 2X OC BLACK PLUS) | US$789.99 | US$49/GB | 2026-10-14 |
- Taiwan value: about 64.7 tok/s on Llama 3.1 8B Instruct (Q4_K_M, 8K), or 2.6 tok/s per NT$1,000.
- US value: about 64.7 tok/s on Llama 3.1 8B Instruct (Q4_K_M, 8K), or 8.2 tok/s per US$100.
A price history chart appears once we have checked this device on two or more days.
All prices →Frequently asked questions
Which LLMs can the GeForce RTX 5060 Ti 16GB run?
With 16 GB and an 8K context, the largest models that fit include: Gemma 4 26B A4B IT, Mistral Small 3.2 24B Instruct (2506), Magistral Small 1.2 (2509), Devstral Small 2 24B Instruct (2512), gpt-oss-20b. See the full table below.
How fast is the GeForce RTX 5060 Ti 16GB for local LLMs?
Generation speed is mostly set by memory bandwidth (448 GB/s). For Llama 3.1 8B Instruct at Q8_0, expect roughly 37 tokens/s; bigger models are slower.
Can the GeForce RTX 5060 Ti 16GB run 70B models?
Llama 3.3 70B Instruct does not fit on the GeForce RTX 5060 Ti 16GB (16 GB), even at Q4_K_M with an 8K context.
Sources
- https://www.nvidia.com/en-us/geforce/graphics-cards/50-series/rtx-5060-family/
- https://www.nvidia.com/en-us/geforce/graphics-cards/compare/
- https://nvidianews.nvidia.com/news/nvidia-blackwell-geforce-rtx-arrives-for-every-gamer-starting-at-299
- https://www.profesionalreview.com/2025/04/17/rtx-5060-ti-escalado-pcie-5-0-4-0-y-3-0/