self-hosted/ai
§01·compatibility · /check

Llama 3.1 70B on RTX 3090

runsllmactive30 series24GB VRAM
model
name
Llama 3.1 70B
slug
llama-3-1-70b
vertical
llm
status
active
repo
open detail ↗
gpu
name
RTX 3090
slug
rtx-3090
vram
24 GB
series
30
open detail ↗
§02·benchmarks
TaskQuantSpeedVRAMWorksConfidenceSourceVerified
llmQ2_K10tok/s24GBmustafa.net· web2026-05-15