self-hosted/ai
§01·spec · /gpus

RTX 4060 Ti 16GB

nvidia40 series16GB VRAM
§02·models that run on this GPU
12 total
ModelVerticalBest speedMin VRAMWorksBenchmarks
Llama 3.2 1Bllm130tokens/s16GB1check ↗
Flux.1 Devimage92s16GB3check ↗
gpt-oss 20Bllm63.2tokens/s16GB2check ↗
Llama 3.1 7Bllm55tok/s16GB1check ↗
Qwen3-8Bllm45.8tokens/s16GB1check ↗
Llama 3.1 8Bllm34tokens/s16GB1check ↗
Llama 3.1 13Bllm30tok/s16GB1check ↗
Qwen3 14Bllm27.4tokens/s16GB2check ↗
Stable Diffusion XLimage12s16GB1check ↗
Llama 3.1 34Bllm8tok/s16GB1check ↗
LTX Video 2.3video16GB1check ↗
Llama 3.1 70Bllm16GB1check ↗
§03·tested recipes
showing 6 of 20