self-hosted/ai
§01·compatibility · /check

Llama 3.1 13B on RTX 4070 Super

runsllmactive40 series12GB VRAM
model
name
Llama 3.1 13B
slug
llama-3-1-13b
vertical
llm
status
active
repo
open detail ↗
gpu
name
RTX 4070 Super
slug
rtx-4070-super
vram
12 GB
series
40
open detail ↗
§02·benchmarks
TaskQuantSpeedVRAMWorksConfidenceSourceVerified
llmQ4_K_M40tok/s12GBmustafa.net· web2026-05-15