§01·model · /models
Llama 3.3 70B
llmactiveLlama 3.3 Community License
70B instruction-tuned LLM by Meta (Llama 3.3), its strongest 70B with quality approaching the 405B tier. Llama 3.3 Community License.
§02·GPUs that run this model
4 total| GPU | VRAM | Series | Best speed | Min VRAM | Works | Benchmarks | Recipe | |
|---|---|---|---|---|---|---|---|---|
| RTX 4090 | 24GB | 40 | 17.79tokens/s | ✓ | 1 | recipe | check ↗ | |
| Apple M2 Max | 64GB | apple | ~ | 0 | recipe | check ↗ | ||
| Apple M3 Max | 48GB | apple | ~ | 0 | recipe | check ↗ | ||
| Apple M4 Max | 48GB | apple | ~ | 0 | recipe | check ↗ |
✓ benchmarked·~ runs via recipe (not benchmarked)·— untested·✕doesn't fit