§01·spec · /gpus
RTX 4090
nvidia40 series24GB VRAM
§02·models that run on this GPU
25 total| Model | Vertical | Best speed | Min VRAM | Works | Benchmarks | |
|---|---|---|---|---|---|---|
| Llama 3.1 7B | llm | 135tok/s | 24GB | ✓ | 1 | check ↗ |
| Llama 3.1 8B | llm | 96.12tokens/s | ✓ | 1 | check ↗ | |
| LTX-Video 0.9.5 | video | 90 | 24GB | ✓ | 1 | check ↗ |
| Llama 3.1 13B | llm | 78tok/s | 24GB | ✓ | 1 | check ↗ |
| HunyuanVideo | video | 75s | 24GB | ✓ | 2 | check ↗ |
| Llama 3.1 34B | llm | 42tok/s | 24GB | ✓ | 1 | check ↗ |
| Flux.1 Dev | image | 18s | 24GB | ✓ | 4 | check ↗ |
| Llama 3.1 70B | llm | 18tok/s | 24GB | ✓ | 1 | check ↗ |
| Llama 70B | llm | 17.79tokens/s | ✓ | 1 | check ↗ | |
| WAN 2.2 | video | 12min | ✓ | 1 | check ↗ | |
| Stable Diffusion XL | image | 5.8it/s | 14GB | ✓ | 4 | check ↗ |
| CogVideoX 1.5 | video | 5min | 12GB | ✓ | 1 | check ↗ |
| Mochi 1 | video | 5min | 20GB | ✓ | 1 | check ↗ |
| LTX-2 | video | 4s | 16GB | ✓ | 2 | check ↗ |
| LTX-Video 2B | video | 4s | 12GB | ✓ | 1 | check ↗ |
| Wan 2.1 | video | 4min | 8GB | ✓ | 2 | check ↗ |
| Wan 2.2 14B | video | 4 | 24GB | ✓ | 1 | check ↗ |
| AnimateDiff SD 1.5 | video | 1min | 8GB | ✓ | 1 | check ↗ |
| LTX-2.3 | video | 1min | ✓ | 1 | check ↗ | |
| Flux.2-Klein-4B | image | 20GB | ✓ | 1 | check ↗ | |
| Flux-Dev | image | ✓ | 1 | check ↗ | ||
| LTX Video 2.3 | video | 18GB | ✓ | 1 | check ↗ | |
| Mochi 1 Preview | video | 20GB | ✓ | 1 | check ↗ | |
| SD1.5 | image | ✓ | 1 | check ↗ | ||
| Wan Video 2.1 14B | video | 24GB | ✓ | 1 | check ↗ |
§03·tested recipes
showing 6 of 20- multimodalbeginner20GB+recipe
Gemma 4 E4B on RTX 4090: Multimodal Inference via BF16 (with optional Q8_0 / Q4_K_M GGUF)
- 3dintermediate12GB+recipe
Waypoint 1.5 on RTX 4090: Real-Time Interactive World Model at 720p
- videointermediate24GB+recipe
LightX2V on RTX 4090: 4-Step Text-to-Video with Distilled Wan2.1-14B
- videointermediate24GB+recipe
Wan 2.2 TI2V-5B on RTX 4090: 720p Text/Image-to-Video in ComfyUI
- imagebeginner20GB+recipe
Flux.2 Klein 4B on RTX 4090: BF16 Full-Resident 4-Step Text-to-Image via Diffusers or ComfyUI
- imageintermediate16GB+recipe
Juggernaut Z on RTX 4090: Cinematic Photoreal Fine-Tune of Z-Image Base at BF16 via Diffusers or ComfyUI