self-hosted/ai
§01·spec · /gpus

RTX 4070

nvidia40 series12GB VRAM
§02·models that run on this GPU
4 total
ModelVerticalBest speedMin VRAMWorksBenchmarks
Qwen3.6-35B-A3B-MTP-UD-Q4_K_XL.ggufllm80.8tokens/s12GB1check ↗
Llama 3.1 8Bllm52.1tokens/s1check ↗
CogVideoX 1.5video10min1check ↗
LTX Video 2.3video12GB1check ↗
§03·tested recipes
2 total