self-hosted/ai
§01·spec · /gpus

RTX 5060

nvidia50 series8GB VRAM

11 open-weights AI models run on the RTX 5060 — see which fit, how fast they go, and the VRAM each needs.

§02·models that run on this GPU
11 total
LLM · 2
ModelBest speedMin VRAMWorksEvidence
Ornith 1.0 9B8GBrecipecheck ↗
Qwen3-4B4GBrecipecheck ↗
Multimodal · 2
ModelBest speedMin VRAMWorksEvidence
Gemma 4 E4B-IT6GBrecipecheck ↗
MiniMind-O4GBrecipecheck ↗
Image · 1
ModelBest speedMin VRAMWorksEvidence
Anima1.12it/s8GB3benchesrecipecheck ↗
TTS · 5
specialized · 1
ModelBest speedMin VRAMWorksEvidence
SAM 34GBrecipecheck ↗
§03·tested recipes
showing 6 of 11