Inside The Machine
AMD graphics card · current · data 2026-10-15

Radeon RX 9070 XT for local AI.

With 16 GB it runs K2 Horizon 7B (needs 8.6 GB). 44 models fit. Published speed: gpt-oss-20b at 140 tokens/sec.

Memory16 GB

vram

Bandwidth640 GB/s

Higher means faster answers.

PriceFrom about $760

As of 2026-10-15. Check before buying.

Which models fit

By memory option.

Usable: 75% on Macs and shared-memory PCs, VRAM minus 1 GB on graphics cards (estimates).
MemoryUsableModels that fitBest three
16 GB15 GB44K2 Horizon 7B (8.6 GB), Gemma 4 12B (11.2 GB), Qwen3.5 9B (9.6 GB)
Speed

Published speeds.

Measured by others, with sources. Not our tests.

ModelTokens/secEngineSetupSource
gpt-oss-20b140llama.cpp · unspecified—community-unverified · 2026-10-15
Questions

Short answers.

What is the best local LLM for the Radeon RX 9070 XT?
With 16 GB, K2 Horizon 7B (needs 8.6 GB, AA 20.6). 44 of 124 models fit.
How fast is the Radeon RX 9070 XT for local AI?
Published: gpt-oss-20b at 140 tokens/sec (llama.cpp, ). These are other people's measurements, not ours.
How much does the Radeon RX 9070 XT cost?
From about $760 (as of 2026-10-15). 2026 prices are inflated by the memory-chip shortage; check before buying.

Specs from Wikipedia – List of AMD GPUs (spec tables) (2026-10-15). Prices are approximate and dated; 2026 prices are inflated by the memory-chip shortage.

AGENT VIEW · text/markdown · or send Accept: text/markdown
# Radeon RX 9070 XT for local AI

URL: https://insidethemachine.ai/machines/radeon-rx-9070-xt
Type: AMD graphics card. Chip: Navi 48. Memory: vram, options 16 GB. Bandwidth: 640 GB/s. Spec source: https://en.wikipedia.org/wiki/List_of_AMD_graphics_processing_units (2026-10-15).
Price: from about $760 (2026-10-15, approximate). Status: current.

## Which models fit

| memory GB | usable GB | models that fit | best 3 |
|---|---|---|---|
| 16 | 15 | 44 | K2 Horizon 7B (8.6 GB), Gemma 4 12B (11.2 GB), Qwen3.5 9B (9.6 GB) |

## Published speeds (not our tests)

- gpt-oss-20b: 140 tok/s decode (llama.cpp, unspecified, , community-unverified) https://llm-speed.com/m/gpt-oss-20b (2026-10-15)

## Questions

**What is the best local LLM for the Radeon RX 9070 XT?**
With 16 GB, K2 Horizon 7B (needs 8.6 GB, AA 20.6). 44 of 124 models fit.

**How fast is the Radeon RX 9070 XT for local AI?**
Published: gpt-oss-20b at 140 tokens/sec (llama.cpp, ). These are other people's measurements, not ours.

**How much does the Radeon RX 9070 XT cost?**
From about $760 (as of 2026-10-15). 2026 prices are inflated by the memory-chip shortage; check before buying.