self-hosted/ai
§01·compatibility · /check

Llama 3.1 70B on RTX 5090

Yes — a published step-by-step recipe documents running Llama 3.1 70B on the RTX 5090 (32 GB). Community benchmark numbers aren't seeded yet, so measured speed and peak VRAM aren't shown.

✓ recipellmactive50 series32GB VRAM
step-by-step recipe for this pair

Llama 3.1 70B on RTX 5090: Fitting a 70B Model on One 32 GB Card with IQ3 GGUF

llmadvanced32GB+
model
name
Llama 3.1 70B
slug
llama-3-1-70b
vertical
llm
status
active
open detail ↗
gpu
name
RTX 5090
slug
rtx-5090
vram
32 GB
series
50
open detail ↗
§02·benchmarks
No verified benchmarks yet. Be the first to contribute one.
§03·common questions
Can you run Llama 3.1 70B on RTX 5090?

Yes — a published step-by-step recipe documents running Llama 3.1 70B on the RTX 5090 (32 GB). Community benchmark numbers aren't seeded yet, so measured speed and peak VRAM aren't shown.

Are there step-by-step instructions for Llama 3.1 70B on RTX 5090?

Yes — a step-by-step recipe documents Llama 3.1 70B on the RTX 5090, linked at the top of this page.