self-hosted/ai
§01·model · /models

Voxtral Mini 3B

ttsactiveApache-2.0

3B audio+text multimodal by Mistral AI. Audio-input (speech-to-text, audio Q&A), NOT TTS synthesis. Explicit ~9.5 GB VRAM in bf16/fp16.

§02·GPUs that run this model
15 total
GPUVRAMSeriesBest speedMin VRAMWorksBenchmarksRecipe
RTX 306012GB30~0recipecheck ↗
RTX 3080 Ti12GB30~0recipecheck ↗
RTX 4060 Ti 16GB16GB40~0recipecheck ↗
RTX 407012GB40~0recipecheck ↗
RTX 4070 Super12GB40~0recipecheck ↗
RTX 4070 Ti12GB40~0recipecheck ↗
RTX 4070 Ti Super16GB40~0recipecheck ↗
RTX 408016GB40~0recipecheck ↗
RTX 4080 Super16GB40~0recipecheck ↗
RTX 5060 Ti16GB50~0recipecheck ↗
RTX 507012GB50~0recipecheck ↗
RTX 5070 Ti16GB50~0recipecheck ↗
RTX 508016GB50~0recipecheck ↗
RX 7800 XT16GBamd~0recipecheck ↗
RX 7900 XTX24GBamd~0recipecheck ↗

benchmarked·~ runs via recipe (not benchmarked)· untested·doesn't fit