self-hosted/ai
§01·model · /models

stablelm2 12b

llmactiveStability AI Community License

12B multilingual LLM by Stability AI (StableLM 2). Stability AI Community License.

§02·GPUs that run this model
1 total
GPUVRAMSeriesBest speedMin VRAMWorksBenchmarksRecipe
RTX 3060 Ti8GB3018.73tokens/s8GB1recipecheck ↗

benchmarked·~ runs via recipe (not benchmarked)· untested·doesn't fit