self-hosted/ai
§01·compatibility · /check

Llama 3.1 70B on RTX 5090

Yes — a published step-by-step recipe documents running Llama 3.1 70B on the RTX 5090 (32 GB). Community benchmark numbers aren't seeded yet, so measured speed and peak VRAM aren't shown.

recipellmactive50 series32GB VRAM
model
name
Llama 3.1 70B
slug
llama-3-1-70b
vertical
llm
status
active
open detail ↗
gpu
name
RTX 5090
slug
rtx-5090
vram
32 GB
series
50
open detail ↗
§02·benchmarks
No verified benchmarks yet. Be the first to contribute one.
§03·common questions
Can you run Llama 3.1 70B on RTX 5090?

Yes — a published step-by-step recipe documents running Llama 3.1 70B on the RTX 5090 (32 GB). Community benchmark numbers aren't seeded yet, so measured speed and peak VRAM aren't shown.

Are there step-by-step instructions for Llama 3.1 70B on RTX 5090?

Yes — a step-by-step recipe documents Llama 3.1 70B on the RTX 5090; see the recipes listed below.

§04·related recipes