self-hosted/ai
§01·spec · /gpus

Apple M2 Pro

appleapple series16GB unified

13 open-weights AI models run on the Apple M2 Pro — see which fit, how fast they go, and the VRAM each needs.

Apple Silicon uses unified memory shared between CPU and GPU. By default the GPU can address about 75% of it; the limit is raisable via Metal’s wired-memory setting.

§02·models that run on this GPU
13 total
Multimodal · 1
ModelBest speedMin VRAMWorksEvidence
Gemma 4 E4B-IT5GBrecipecheck ↗
Image · 1
ModelBest speedMin VRAMWorksEvidence
Z-Image Turbo6GBrecipecheck ↗
Video · 1
ModelBest speedMin VRAMWorksEvidence
LTX-2.314GBrecipecheck ↗
TTS · 2
ModelBest speedMin VRAMWorksEvidence
Kokoro TTS1GBrecipecheck ↗
VoxCPM2GBrecipecheck ↗
§03·tested recipes
showing 6 of 13