§01·model · /models
Llama 3.1 34B
llmactive
§02·GPUs that run this model
5 total| GPU | VRAM | Series | Best speed | Min VRAM | Works | Benchmarks | |
|---|---|---|---|---|---|---|---|
| RTX 4090 | 24GB | 40 | 42tok/s | 24GB | ✓ | 1 | check ↗ |
| RTX 3090 | 24GB | 30 | 28tok/s | 24GB | ✓ | 1 | check ↗ |
| Apple M3 Max | 0GB | apple | 11tok/s | 64GB | ✓ | 1 | check ↗ |
| RTX 4060 Ti 16GB | 16GB | 40 | 8tok/s | 16GB | ✓ | 1 | check ↗ |
| RTX 4070 Super | 12GB | 40 | 12GB | ✕ | 1 | check ↗ |