§01·spec · /gpus

RTX 3060 Ti

Name: RTX 3060 Ti local AI benchmarks
Creator: Smeltcore
License: https://creativecommons.org/licenses/by-sa/4.0/

nvidia30 series8GB VRAM

22 open-weights AI models run on the RTX 3060 Ti — see which fit, how fast they go, and the VRAM each needs.

§02·models that run on this GPU

22 total

LLM · 12

Model	Best speed	Min VRAM	Works	Evidence
llama2 7b	73.07tokens/s	8GB	✓	1benchrecipe	check ↗
wizardlm2 7b	70.79tokens/s	8GB	✓	1benchrecipe	check ↗
qwen2 7b	63.73tokens/s	8GB	✓	1benchrecipe	check ↗
Qwen2.5 7B	58.13tokens/s	8GB	✓	1benchrecipe	check ↗
Llama 3.1 8B	57.34tokens/s	8GB	✓	1benchrecipe	check ↗
gemma 7b	31.95tokens/s	8GB	✓	1benchrecipe	check ↗
falcon2 11b	31.2tokens/s	8GB	✓	1benchrecipe	check ↗
Gemma 2 9B	23.8tokens/s	8GB	✓	1benchrecipe	check ↗
stablelm2 12b	18.73tokens/s	8GB	✓	1benchrecipe	check ↗
llama2 13b	9.25tokens/s	8GB	✓	1benchrecipe	check ↗
Ornith 1.0 9B		8GB	✓	recipe	check ↗
Qwen3-4B		4GB	✓	recipe	check ↗

Multimodal · 3

Model	Best speed	Min VRAM	Works	Evidence
llava 7b	72tokens/s	8GB	✓	1benchrecipe	check ↗
Gemma 4 E4B-IT		6GB	✓	recipe	check ↗
MiniMind-O		4GB	✓	recipe	check ↗

Video · 1

Model	Best speed	Min VRAM	Works	Evidence
AnimateDiff		6GB	✓	recipe	check ↗

TTS · 5

Model	Min VRAM	Works	Evidence
Foundation-1	8GB	✓	recipe	check ↗
Kokoro TTS	2GB	✓	recipe	check ↗
OmniVoice	4GB	✓	recipe	check ↗
OpenAudio S1 Mini	5GB	✓	recipe	check ↗
VoxCPM	5GB	✓	recipe	check ↗

specialized · 1

Model	Best speed	Min VRAM	Works	Evidence
SAM 3		4GB	✓	recipe	check ↗

§03·tested recipes

showing 6 of 22