self-hosted/ai
§01·spec · /gpus

RTX 4090

nvidia40 series24GB VRAM

45 open-weights AI models run on the RTX 4090 — see which fit, how fast they go, and the VRAM each needs.

RTX 4090D, the China-market export version, ships the same 24 GB of GDDR6X on the same 384-bit busso every “fits / doesn’t fit” verdict on this page applies to it unchanged. It has 14,592 CUDA cores instead of 16,384, so the speeds here are an upper bound for it rather than a match. Nothing on the RTX 4090D has been measured yet — send a run if you have one.

§02·models that run on this GPU
45 total
LLM · 16
Multimodal · 8
Image · 9
Video · 11
3D · 1
§03·tested recipes
showing 6 of 47