Hardware for local LLMs
GPUs, Apple Silicon Macs and unified-memory mini PCs, with the specs that decide what you can run: memory size and memory bandwidth.
Last updated: 2026-10-14 · JSON
Consumer GPUs
| Model | Memory | Memory bandwidth | Power | Launch | Launch price |
|---|---|---|---|---|---|
| GeForce RTX 3060 (12 GB) | 12 GB | 360 GB/s | 170 W | 2021-02 | US$329 |
| GeForce RTX 3090 | 24 GB | 936 GB/s | 350 W | 2020-09 | US$1,499 |
| GeForce RTX 4060 Ti 16GB | 16 GB | 288 GB/s | 165 W | 2023-07 | US$499 |
| GeForce RTX 4080 SUPER | 16 GB | 736 GB/s | 320 W | 2024-01 | US$999 |
| GeForce RTX 4090 | 24 GB | 1008 GB/s | 450 W | 2022-10 | US$1,599 |
| GeForce RTX 5060 Ti 16GB | 16 GB | 448 GB/s | 180 W | 2025-04 | US$429 |
| GeForce RTX 5070 | 12 GB | 672 GB/s | 250 W | 2025-03 | US$549 |
| GeForce RTX 5070 Ti | 16 GB | 896 GB/s | 300 W | 2025-02 | US$749 |
| GeForce RTX 5080 | 16 GB | 960 GB/s | 360 W | 2025-01 | US$999 |
| GeForce RTX 5090 | 32 GB | 1792 GB/s | 575 W | 2025-01 | US$1,999 |
| Radeon RX 7900 XT | 20 GB | 800 GB/s | 315 W | 2022-12 | US$899 |
| Radeon RX 7900 XTX | 24 GB | 960 GB/s | 355 W | 2022-12 | US$999 |
| Radeon RX 9060 XT 16GB | 16 GB | 320 GB/s | 160 W | 2025-06 | US$349 |
| Radeon RX 9070 XT | 16 GB | 640 GB/s | 304 W | 2025-03 | US$599 |
| Arc B580 | 12 GB | 456 GB/s | 190 W | 2024-12 | US$249 |
Workstation GPUs
| Model | Memory | Memory bandwidth | Power | Launch | Launch price |
|---|---|---|---|---|---|
| RTX A6000 | 48 GB | 768 GB/s | 300 W | 2020-12 | US$4,650 |
| RTX 6000 Ada Generation | 48 GB | 960 GB/s | 300 W | 2022-12 | US$6,800 |
| RTX PRO 5000 72GB Blackwell | 72 GB | 1344 GB/s | 300 W | 2025-12 | – |
| RTX PRO 6000 Blackwell Workstation Edition | 96 GB | 1792 GB/s | 600 W | 2025-04 | US$8,565 |
| Radeon AI PRO R9700 | 32 GB | 640 GB/s | 300 W | 2025-07 | US$1,299 |
| Arc Pro B60 | 24 GB | 456 GB/s | 200 W | 2025-06 | – |
| Arc Pro B70 | 32 GB | 608 GB/s | 230 W | 2026-03 | US$949 |
Apple Silicon
| Model | Memory | Memory bandwidth | Power | Launch | Launch price |
|---|---|---|---|---|---|
| M4 Pro | 24–64 GB | 273 GB/s | – | 2024-11 | US$1,399 |
| M4 Max (14-core CPU / 32-core GPU) | 36 GB | 410 GB/s | – | 2024-11 | US$3,199 |
| M4 Max (16-core CPU / 40-core GPU) | 48–128 GB | 546 GB/s | – | 2024-11 | US$3,699 |
| M3 Ultra | 96–512 GB | 819 GB/s | – | 2025-03 | US$3,999 |
| M5 | 16–32 GB | 153 GB/s | – | 2025-10 | US$1,599 |
| M5 Pro | 24–64 GB | 307 GB/s | – | 2026-03 | US$2,199 |
| M5 Max (18-core CPU / 32-core GPU) | 36 GB | 460 GB/s | – | 2026-03 | US$3,599 |
| M5 Max (18-core CPU / 40-core GPU) | 48–128 GB | 614 GB/s | – | 2026-03 | US$4,099 |
| M5 Ultra | 96–512 GB | 1200 GB/s | – | 2026-09 | US$5,499 |
| M6 (16GB configuration, 153 GB/s) | 16 GB | 153 GB/s | – | 2026-09 | US$899 |
| M6 (24GB/32GB configurations, 170 GB/s) | 24–32 GB | 170 GB/s | – | 2026-09 | – |
Unified-memory mini PCs
| Model | Memory | Memory bandwidth | Power | Launch | Launch price |
|---|---|---|---|---|---|
| DGX Spark | 64–128 GB | 273 GB/s | 140 W | 2025-10 | US$3,999 |
| RTX Spark (N1X) laptops & compact desktops | 64–128 GB | 300 GB/s | 80 W | 2026-10 | – |
| Ryzen AI Max+ 395 (Strix Halo) systems | 32–128 GB | 256 GB/s | 120 W | 2025-03 | US$1,999 |
| Ryzen AI Max+ PRO 495 (Gorgon Halo) systems | 192 GB | 273 GB/s | 120 W | 2026-10 | – |