self-hosted/ai
§01·model · /models

Qwen2.5 7B

llmactiveApache-2.0

7B instruction-tuned LLM by Alibaba (Qwen2.5). Apache-2.0.

§02·GPUs that run this model
1 total
GPUVRAMSeriesBest speedMin VRAMWorksBenchmarksRecipe
RTX 3060 Ti8GB3058.13tokens/s8GB1recipecheck ↗

benchmarked·~ runs via recipe (not benchmarked)· untested·doesn't fit