Hardware for Local LLMs

Specs for 26 GPUs and Apple Silicon devices stay on this page. Separate per-SKU URLs were consolidated here for good — they return 410 and are not coming back.

All 26 GPUs, mini PCs, and Apple Silicon devices tracked for local AI inference. Use the VRAM calculator to see which models fit each device, or open the compare table. Kept guides such as the RTX 4090 LLM guide stay on their own URLs.

NVIDIA GPUs

NVIDIA GeForce RTX 4060 (8GB)
8 GB VRAM ~272 GB/s 115W $609.99
NVIDIA GeForce RTX 4070 (12GB)
12 GB VRAM ~504 GB/s 200W $549
NVIDIA GeForce RTX 4090 (24GB)
24 GB VRAM ~1008 GB/s 450W $1,599
NVIDIA GeForce RTX 3090 (24GB)
24 GB VRAM ~936 GB/s 350W $499
NVIDIA GeForce RTX 5090 (32GB)
32 GB VRAM ~1792 GB/s 575W $7,398
NVIDIA RTX 4080 (16GB)
16 GB VRAM ~716 GB/s 320W $999
NVIDIA RTX 4060 Ti (16GB)
16 GB VRAM ~288 GB/s 165W $629.99
NVIDIA RTX 5080 (16GB)
16 GB VRAM ~960 GB/s 360W $1,809.86
NVIDIA RTX 5070 (12GB)
12 GB VRAM ~672 GB/s 250W $937.39
NVIDIA RTX 5070 Ti (16GB)
16 GB VRAM ~896 GB/s 300W $1,490
NVIDIA RTX 4070 Ti Super (16GB)
16 GB VRAM ~672 GB/s 285W $799
NVIDIA DGX Spark
128 GB VRAM ~273 GB/s 170W $3,000
PNY GeForce RTX 5060 Ti (16GB)
16 GB VRAM ~448 GB/s 180W No in-stock price

AMD GPUs

AMD Radeon RX 7900 XTX (24GB)
24 GB VRAM ~960 GB/s 355W $799

Intel GPUs

Intel Arc B580 (12GB)
12 GB VRAM ~456 GB/s 190W $249

Apple Silicon

Apple Mac Studio (M5 Max, 36GB)
36 GB unified $2,449

In stock (2026-10-01)

Apple Mac mini (M5 Pro, 24GB)
24 GB unified ~307 GB/s $1,669.99

In stock (2026-10-01)

Apple Mac mini (M4, 16GB)
16 GB unified ~120 GB/s 25W No in-stock price

Price needs re-check (no clean buy box, 2026-10-01)

Apple Mac mini (M4, 24GB)
24 GB unified ~120 GB/s 25W No in-stock price

Price needs re-check (no clean buy box, 2026-10-01)

Apple Mac mini (M4 Pro, 24GB)
24 GB unified ~273 GB/s 35W $1,569.99

In stock — sold by Amazon.com (2026-10-01)

Apple Mac mini (M4 Pro, 48GB)
48 GB unified ~273 GB/s 40W No in-stock price

Currently unavailable (2026-10-01)

Apple Mac Studio (M4 Max, 64GB)
64 GB unified ~400 GB/s 85W No in-stock price

Currently unavailable (2026-10-01)

Apple Mac Studio (M4 Max, 128GB)
128 GB unified ~400 GB/s 85W No in-stock price

Price not re-checked (2026-10-01) — configure 64GB+ at Apple

Mini PCs

GMKtec EVO-X2 (Ryzen AI Max+ 395, 128GB)
128 GB unified ~256 GB/s 140W $3,649.99

96–128 GB unified at ~256 GB/s. Q4: dense 70B fits and is slow (~5 tok/s class); Qwen3.8-Flash-Next MoE fits; DeepSeek-V4-Flash only at an aggressive sub-Q4 quant (~155 GB at a normal 4-bit). Not CUDA.

In stock — sold by GMKtec-US ($3,649.99, 2026-10-02)

Beelink GTR9 Pro (128GB) — caution
128 GB unified ~256 GB/s $4,349

Same Q4 fit as the EVO-X2: 128 GB at ~256 GB/s. DeepSeek-V4-Flash only aggressive; Qwen3.8-Flash-Next MoE; dense 70B Q4 slow. Not the default Halo buy.

Low stock — only 3 left, Beelink Direct, $4,349.00 on 2026-10-01. Confirm NIC revision before buying.

Beelink GTR9 Pro (128GB, OOS watchlist)
128 GB unified ~256 GB/s No in-stock price

Same 96–128 GB at ~256 GB/s tier when stocked. Not a buy: unavailable on 2026-10-01, 3.4 stars from 20 product-specific ratings, repeated 10GbE failures.

Out of stock on 2026-10-01. No price. 3.4/20 product-specific ratings, NIC failures.

Browse All Models All Guides Compare GPUs VRAM Calculator