§01·compatibility · /check
Mistral Small 3.2 24B on RTX 4080
Yes — a published step-by-step recipe documents running Mistral Small 3.2 24B on the RTX 4080 (16 GB). Community benchmark numbers aren't seeded yet, so measured speed and peak VRAM aren't shown.
✓ recipellmactive40 series16GB VRAM
step-by-step recipe for this pair
Mistral Small 3.2 24B on RTX 4080: Local Private Assistant via llama.cpp / Ollama (16GB)
llmintermediate16GB+
model
- name
- Mistral Small 3.2 24B
- slug
- mistral-small-3-2-24b
- vertical
- llm
- status
- active
- repo
- huggingface.co ↗
§02·benchmarks
No verified benchmarks yet. Be the first to contribute one.
§03·more Mistral Small 3.2 24B recipes
- llmintermediate24GB+
Mistral Small 3.2 24B on RX 7900 XTX: Local Private Assistant via llama.cpp-HIP / Ollama (24GB ROCm)
- llmintermediate64GB+
Mistral Small 3.2 24B on M2 Max (64GB): Local Private Assistant via llama.cpp / Ollama on Apple Metal
- llmintermediate48GB+
Mistral Small 3.2 24B on M3 Max (48GB): Local Private Assistant via llama.cpp / Ollama on Apple Metal
- llmintermediate32GB+
Mistral Small 3.2 24B on RTX 5090: Local Private Assistant via llama.cpp / Ollama (32GB)
§04·common questions
Can you run Mistral Small 3.2 24B on RTX 4080?
Yes — a published step-by-step recipe documents running Mistral Small 3.2 24B on the RTX 4080 (16 GB). Community benchmark numbers aren't seeded yet, so measured speed and peak VRAM aren't shown.
Are there step-by-step instructions for Mistral Small 3.2 24B on RTX 4080?
Yes — a step-by-step recipe documents Mistral Small 3.2 24B on the RTX 4080, linked at the top of this page.