self-hosted/ai
§01·model · /models

qwen2 7b

llmactiveApache-2.0

7B instruction-tuned LLM by Alibaba (Qwen2). Apache-2.0.

Download· 4 variants
§02·GPUs that run this model
1 total
GPUVRAMSeriesBest speedMin VRAMWorksBenchmarksRecipe
RTX 3060 Ti8GB3063.73tokens/s8GB1recipecheck ↗

benchmarked·~ runs via recipe (not benchmarked)· untested·doesn't fit