§01·spec · /gpus

RTX 4080

Name: RTX 4080 local AI benchmarks
Creator: Smeltcore
License: https://creativecommons.org/licenses/by-sa/4.0/

nvidia40 series16GB VRAM

43 open-weights AI models run on the RTX 4080 — see which fit, how fast they go, and the VRAM each needs.

§02·models that run on this GPU

43 total

LLM · 11

Model	Best speed	Min VRAM	Works	Evidence
gpt-oss 20B	136.5tokens/s	16GB	✓	2benchesrecipe	check ↗
Qwen3-8B	102.7tokens/s	16GB	✓	2benchesrecipe	check ↗
Qwen3 14B	62tokens/s	16GB	✓	2benchesrecipe	check ↗
Devstral Small 2 (24B)		16GB	✓	recipe	check ↗
Gemma 4 12B		16GB	✓	recipe	check ↗
Llama 3.1 8B		10GB	✓	recipe	check ↗
Mistral Nemo 12B		16GB	✓	recipe	check ↗
Mistral Small 3.2 24B		16GB	✓	recipe	check ↗
North Mini Code 1.0		16GB	✓	recipe	check ↗
Ornith 1.0 9B		12GB	✓	recipe	check ↗
Phi-4		16GB	✓	recipe	check ↗

Multimodal · 2

Model	Best speed	Min VRAM	Works	Evidence
Gemma 4 E4B-IT		6GB	✓	recipe	check ↗
MiniMind-O		4GB	✓	recipe	check ↗

Image · 11

Model	Min VRAM	Works	Evidence
Anima	7GB	✓	recipe	check ↗
Chroma V48	16GB	✓	recipe	check ↗
ERNIE-Image-Turbo	12GB	✓	recipe	check ↗
Flux.2-Klein-4B	13GB	✓	recipe	check ↗
HiDream-O1-Image	10GB	✓	recipe	check ↗
Juggernaut Z	16GB	✓	recipe	check ↗
Krea 2	16GB	✓	recipe	check ↗
LongCat Image	16GB	✓	recipe	check ↗
Qwen-Image	13GB	✓	recipe	check ↗
SenseNova U1	12GB	✓	recipe	check ↗
Z-Image Turbo	16GB	✓	recipe	check ↗

Video · 4

Model	Min VRAM	Works	Evidence
LightX2V	8GB	✓	recipe	check ↗
LTX-2.3	16GB	✓	recipe	check ↗
Sulphur 2	16GB	✓	recipe	check ↗
WAN 2.2	8GB	✓	recipe	check ↗

3D · 3

Model	Min VRAM	Works	Evidence
Hunyuan3D	10GB	✓	recipe	check ↗
TRELLIS image-large	16GB	✓	recipe	check ↗
Waypoint 1.5	12GB	✓	recipe	check ↗

TTS · 10

Model	Min VRAM	Works	Evidence
ACE-Step 1.5 XL	12GB	✓	recipe	check ↗
Foundation-1	8GB	✓	recipe	check ↗
Kokoro TTS	1GB	✓	recipe	check ↗
MOSS-Audio	12GB	✓	recipe	check ↗
OmniVoice	4GB	✓	recipe	check ↗
OpenAudio S1 Mini	5GB	✓	recipe	check ↗
Qwen3-TTS	8GB	✓	recipe	check ↗
VoxCPM	5GB	✓	recipe	check ↗
VoxCPM2	8GB	✓	recipe	check ↗
Voxtral Mini 3B	10GB	✓	recipe	check ↗

specialized · 2

Model	Best speed	Min VRAM	Works	Evidence
KiMoDo		3GB	✓	recipe	check ↗
SAM 3		4GB	✓	recipe	check ↗

§03·tested recipes

showing 6 of 43