§01·spec · /gpus

RTX 5090

Name: RTX 5090 local AI benchmarks
Creator: Smeltcore
License: https://creativecommons.org/licenses/by-sa/4.0/

nvidia50 series32GB VRAM

40 open-weights AI models run on the RTX 5090 — see which fit, how fast they go, and the VRAM each needs.

§02·models that run on this GPU

40 total

LLM · 14

Model	Best speed	Min VRAM	Works	Evidence
gpt-oss 20B	298.2tokens/s	16GB	✓	3benchesrecipe	check ↗
Qwen3 30B-A3B	226.1tokens/s	19GB	✓	2benchesrecipe	check ↗
Qwen3-8B	200.4tokens/s	6GB	✓	3benchesrecipe	check ↗
Qwen3 14B	123.8tokens/s	17GB	✓	3benchesrecipe	check ↗
Qwen3 32B	61.4tokens/s	29GB	✓	3benchesrecipe	check ↗
DeepSeek R1 Distill 14B		10GB	✓	recipe	check ↗
Devstral Small 2 (24B)		32GB	✓	recipe	check ↗
Laguna XS 2.1		24GB	✓	recipe	check ↗
Llama 3.1 70B		32GB	✓	recipe	check ↗
Llama 3.1 8B		10GB	✓	recipe	check ↗
Mistral Small 3.2 24B		32GB	✓	recipe	check ↗
North Mini Code 1.0		32GB	✓	recipe	check ↗
Ornith 1.0 35B		32GB	✓	recipe	check ↗
Phi-4		32GB	✓	recipe	check ↗

Multimodal · 5

Model	Best speed	Min VRAM	Works	Evidence
Gemma 4 26B MoE	180.3tokens/s	29GB	✓	2benchesrecipe	check ↗
Qwen3.5 35B	165.2tokens/s	24GB	✓	2benchesrecipe	check ↗
Gemma4 31B	61.1tokens/s	20GB	✓	2benchesrecipe	check ↗
Qwen3.5 27B	58.8tokens/s	20GB	✓	2benchesrecipe	check ↗
Gemma 4 E4B-IT		20GB	✓	recipe	check ↗

Image · 8

Model	Best speed	Min VRAM	Works	Evidence
Flux.1 Dev	9.55s	24GB	✓	4benchesrecipe	check ↗
Chroma V48		24GB	✓	recipe	check ↗
ERNIE-Image-Turbo		24GB	✓	recipe	check ↗
Flux.2-Klein-4B		9GB	✓	recipe	check ↗
HiDream-O1-Image		17GB	✓	recipe	check ↗
Krea 2		16GB	✓	recipe	check ↗
LongCat Image		18GB	✓	recipe	check ↗
Qwen-Image		21GB	✓	recipe	check ↗

Video · 8

Model	Min VRAM	Works	Evidence
CogVideoX 1.5	20GB	✓	recipe	check ↗
HunyuanVideo 1.5	14GB	✓	recipe	check ↗
LightX2V	22GB	✓	recipe	check ↗
LTX-2.3	28GB	✓	recipe	check ↗
Mochi 1	22GB	✓	recipe	check ↗
Sulphur 2	31GB	✓	recipe	check ↗
WAN 2.2	8GB	✓	recipe	check ↗
Wan 2.2 14B	24GB	✓	recipe	check ↗

3D · 4

Model	Min VRAM	Works	Evidence
Hunyuan3D	29GB	✓	recipe	check ↗
TRELLIS.2-4B	24GB	✓	recipe	check ↗
TRELLIS image-large	16GB	✓	recipe	check ↗
Waypoint 1.5	12GB	✓	recipe	check ↗

TTS · 1

Model	Best speed	Min VRAM	Works	Evidence
Kokoro TTS		3GB	✓	recipe	check ↗

§03·tested recipes

showing 6 of 40