self-hosted/ai
§01·model · /models

Llama 3.1 70B

llmactiveLlama 3.1 Community License

70B instruction-tuned LLM by Meta (Llama 3.1) with 128K context. Llama 3.1 Community License.

§02·GPUs that run this model
1 total
GPUVRAMSeriesBest speedMin VRAMWorksBenchmarksRecipe
RTX 509032GB50~0recipecheck ↗

benchmarked·~ runs via recipe (not benchmarked)· untested·doesn't fit