§01·model · /models
Gemma 2 9B
llmactiveGemma License
9B instruction-tuned LLM by Google (Gemma 2), known for strong quality-per-size in its generation. Gemma License.
§02·GPUs that run this model
1 total| GPU | VRAM | Series | Best speed | Min VRAM | Works | Benchmarks | Recipe | |
|---|---|---|---|---|---|---|---|---|
| RTX 3060 Ti | 8GB | 30 | 23.8tokens/s | 8GB | ✓ | 1 | recipe | check ↗ |
✓ benchmarked·~ runs via recipe (not benchmarked)·— untested·✕doesn't fit