§01·spec · /gpus

RTX 4060 Ti 16GB

Name: RTX 4060 Ti 16GB local AI benchmarks
Creator: Smeltcore
License: https://creativecommons.org/licenses/by-sa/4.0/

nvidia40 series16GB VRAM

30 open-weights AI models run on the RTX 4060 Ti 16GB — see which fit, how fast they go, and the VRAM each needs.

§02·models that run on this GPU

30 total

LLM · 4

Model	Best speed	Min VRAM	Works	Evidence
gpt-oss 20B	63.2tokens/s	16GB	✓	2benchesrecipe	check ↗
Qwen3-8B	45.8tokens/s	16GB	✓	1benchrecipe	check ↗
Qwen3 14B	27.4tokens/s	16GB	✓	2benchesrecipe	check ↗
Ornith 1.0 9B		12GB	✓	recipe	check ↗

Multimodal · 2

Model	Best speed	Min VRAM	Works	Evidence
Gemma 4 E4B-IT		6GB	✓	recipe	check ↗
MiniMind-O		4GB	✓	recipe	check ↗

Image · 8

Model	Min VRAM	Works	Evidence
Chroma V48	16GB	✓	recipe	check ↗
HiDream-O1-Image	10GB	✓	recipe	check ↗
Juggernaut Z	16GB	✓	recipe	check ↗
Krea 2	16GB	✓	recipe	check ↗
LongCat Image	16GB	✓	recipe	check ↗
Qwen-Image	13GB	✓	recipe	check ↗
SenseNova U1	12GB	✓	recipe	check ↗
Z-Image Turbo	16GB	✓	1benchrecipe	check ↗

Video · 5

Model	Min VRAM	Works	Evidence
LightX2V	8GB	✓	recipe	check ↗
LTX-2.3	16GB	✓	1benchrecipe	check ↗
LTX-Video 2B	10GB	✓	recipe	check ↗
Sulphur 2	16GB	✓	recipe	check ↗
WAN 2.2	8GB	✓	recipe	check ↗

TTS · 10

Model	Min VRAM	Works	Evidence
ACE-Step 1.5 XL	12GB	✓	recipe	check ↗
Foundation-1	8GB	✓	recipe	check ↗
Kokoro TTS	2GB	✓	recipe	check ↗
MOSS-Audio	12GB	✓	recipe	check ↗
OmniVoice	4GB	✓	recipe	check ↗
OpenAudio S1 Mini	5GB	✓	recipe	check ↗
Qwen3-TTS	8GB	✓	recipe	check ↗
VoxCPM	5GB	✓	recipe	check ↗
VoxCPM2	8GB	✓	recipe	check ↗
Voxtral Mini 3B	10GB	✓	recipe	check ↗

specialized · 1

Model	Best speed	Min VRAM	Works	Evidence
SAM 3		4GB	✓	recipe	check ↗

§03·tested recipes

showing 6 of 30