self-hosted/ai
§01·model · /models

wizardlm2 7b

llmactiveApache-2.0

7B instruction-following LLM by Microsoft (WizardLM-2), trained with Evol-Instruct. The original repo was withdrawn; served from a community mirror. Apache-2.0.

§02·GPUs that run this model
1 total
GPUVRAMSeriesBest speedMin VRAMWorksBenchmarksRecipe
RTX 3060 Ti8GB3070.79tokens/s8GB1recipecheck ↗

benchmarked·~ runs via recipe (not benchmarked)· untested·doesn't fit