§01·model · /models
Llama 3.1 70B
llmactive
§02·GPUs that run this model
4 total| GPU | VRAM | Series | Best speed | Min VRAM | Works | Benchmarks | |
|---|---|---|---|---|---|---|---|
| RTX 4090 | 24GB | 40 | 18tok/s | 24GB | ✓ | 1 | check ↗ |
| RTX 3090 | 24GB | 30 | 10tok/s | 24GB | ✓ | 1 | check ↗ |
| Apple M3 Max | 0GB | apple | 5tok/s | 64GB | ✓ | 1 | check ↗ |
| RTX 4060 Ti 16GB | 16GB | 40 | 16GB | ✕ | 1 | check ↗ |