self-hosted/ai
§01·spec · /gpus

RTX 3060

nvidia30 series12GB VRAM
§02·models that run on this GPU
14 total
ModelVerticalBest speedMin VRAMWorksBenchmarks
Llama-2 7Bllm60.2tokens/s1check ↗
Llama 3.1 7Bllm45tok/s12GB1check ↗
Llama 3.1 8Bllm42tokens/s1check ↗
Qwen3-8Bllm42tokens/s1check ↗
Llama-2 13Bllm32.8tokens/s1check ↗
DeepSeek R1 Distill 14Bllm29.4tokens/s1check ↗
Qwen3 14Bllm22.7tokens/s1check ↗
Llama 3.1 13Bllm22tok/s12GB1check ↗
LTX-Video 0.9.5video712GB1check ↗
Stable Diffusion XLimage1.4it/s12GB1check ↗
HunyuanVideovideo8GB1check ↗
Kokoro TTStts1check ↗
Wan 2.1video11GB1check ↗
Flux.1 Devimage12GB1check ↗