self-hosted/ai
§01·spec · /gpus

Apple M3 Max

appleapple series0GB VRAM
§02·models that run on this GPU
4 total
ModelVerticalBest speedMin VRAMWorksBenchmarks
Llama 3.1 7Bllm40tok/s64GB1check ↗
Llama 3.1 13Bllm22tok/s64GB1check ↗
Llama 3.1 34Bllm11tok/s64GB1check ↗
Llama 3.1 70Bllm5tok/s64GB1check ↗