§01·model · /models
llava 7b
multimodalactiveLlama 2 Community License
7B open vision-language model (LLaVA 1.5) by Liu et al. - a Vicuna/Llama-2 LLM paired with a CLIP visual encoder for image understanding and VQA. Llama 2 Community License.
§02·GPUs that run this model
1 total| GPU | VRAM | Series | Best speed | Min VRAM | Works | Benchmarks | Recipe | |
|---|---|---|---|---|---|---|---|---|
| RTX 3060 Ti | 8GB | 30 | 72tokens/s | 8GB | ✓ | 1 | recipe | check ↗ |
✓ benchmarked·~ runs via recipe (not benchmarked)·— untested·✕doesn't fit