self-hosted/ai
§01·spec · /gpus

RTX 3060

nvidia30 series12GB VRAM

32 open-weights AI models run on the RTX 3060 — see which fit, how fast they go, and the VRAM each needs.

§02·models that run on this GPU
32 total
LLM · 5
ModelBest speedMin VRAMWorksEvidence
gpt-oss 20B64tokens/s12GB1benchrecipecheck ↗
Qwen3-8B55.2tokens/s12GB2benchesrecipecheck ↗
Llama 3.1 8B52.2tokens/s10GB2benchesrecipecheck ↗
Qwen3 14B31.2tokens/s12GB2benchesrecipecheck ↗
Ornith 1.0 9B12GBrecipecheck ↗
Multimodal · 2
ModelBest speedMin VRAMWorksEvidence
Gemma 4 E4B-IT45tokens/s6GB1benchrecipecheck ↗
MiniMind-O4GBrecipecheck ↗
Video · 2
ModelBest speedMin VRAMWorksEvidence
LightX2V12GBrecipecheck ↗
WAN 2.28GBrecipecheck ↗
3D · 1
ModelBest speedMin VRAMWorksEvidence
Hunyuan3D10GBrecipecheck ↗
specialized · 2
ModelBest speedMin VRAMWorksEvidence
KiMoDo3GBrecipecheck ↗
SAM 34GBrecipecheck ↗
§03·tested recipes
showing 6 of 32