self-hosted/ai
§01·spec · /gpus

Apple M2 Pro

appleapple series16GB unified

17 open-weights AI models run on the Apple M2 Pro — see which fit, how fast they go, and the VRAM each needs.

Apple Silicon uses unified memory shared between CPU and GPU. Of this machine’s 16 GB the GPU addresses 10.7 GiB by default — exactly two thirdsand the limit is raisable via Metal’s wired-memory setting.

§02·models that run on this GPU
17 total
LLM · 9
Multimodal · 4
Image · 1
Video · 1
TTS · 2
§03·tested recipes
showing 6 of 17