self-hosted/ai
§01·compatibility · /check

Llama 3.1 8B on RX 7900 XTX

runsllmactiveamd series24GB VRAM
model
name
Llama 3.1 8B
slug
llama-3-1-8b
vertical
llm
status
active
open detail ↗
gpu
name
RX 7900 XTX
slug
rx-7900-xtx
vram
24 GB
series
amd
open detail ↗
§02·benchmarks
TaskQuantSpeedVRAMWorksConfidenceSourceVerified
llmQ4_K - Medium51.3tokens/s24GBlocalscore.ai· web2026-05-15
§03·related recipes