self-hosted/ai
§01·spec · /gpus

RTX 5090

nvidia50 series32GB VRAM
§02·models that run on this GPU
12 total
ModelVerticalBest speedMin VRAMWorksBenchmarks
gpt-oss 20Bllm298.2tokens/s3check ↗
Qwen3 30B-A3Bllm226.1tokens/s2check ↗
Qwen3-8Bllm200.4tokens/s3check ↗
Gemma 4 26B MoEllm180.3tokens/s2check ↗
Qwen3.5 35Bllm165.2tokens/s2check ↗
Qwen3 30Bllm141.63tokens/s1check ↗
Qwen3 14Bllm123.8tokens/s3check ↗
Qwen3 32Bllm61.4tokens/s3check ↗
Gemma4 31Bllm61.1tokens/s2check ↗
Qwen3.5 27Bllm58.8tokens/s2check ↗
Flux.1 Devimage9.55s32GB7check ↗
Stable Diffusion XLimage8.8it/s32GB2check ↗
§03·tested recipes
showing 6 of 17