§01·model · /models
llama2 7b
llmactiveLlama 2 Community License
7B chat LLM by Meta (Llama 2) - legacy baseline model. Llama 2 Community License.
§02·GPUs that run this model
1 total| GPU | VRAM | Series | Best speed | Min VRAM | Works | Benchmarks | Recipe | |
|---|---|---|---|---|---|---|---|---|
| RTX 3060 Ti | 8GB | 30 | 73.07tokens/s | 8GB | ✓ | 1 | recipe | check ↗ |
✓ benchmarked·~ runs via recipe (not benchmarked)·— untested·✕doesn't fit