§01·compatibility · /check
Mistral Small 3.2 24B on RTX 4090
Yes — a published step-by-step recipe documents running Mistral Small 3.2 24B on the RTX 4090 (24 GB). Community benchmark numbers aren't seeded yet, so measured speed and peak VRAM aren't shown.
✓ recipellmactive40 series24GB VRAM
model
- name
- Mistral Small 3.2 24B
- slug
- mistral-small-3-2-24b
- vertical
- llm
- status
- active
- repo
- huggingface.co ↗
§02·benchmarks
No verified benchmarks yet. Be the first to contribute one.
§03·common questions
Can you run Mistral Small 3.2 24B on RTX 4090?
Yes — a published step-by-step recipe documents running Mistral Small 3.2 24B on the RTX 4090 (24 GB). Community benchmark numbers aren't seeded yet, so measured speed and peak VRAM aren't shown.
Are there step-by-step instructions for Mistral Small 3.2 24B on RTX 4090?
Yes — a step-by-step recipe documents Mistral Small 3.2 24B on the RTX 4090; see the recipes listed below.
§04·related recipes
- llmintermediate24GB+
Mistral Small 3.2 24B on RTX 4090: Local Private Assistant via llama.cpp / Ollama (24GB)
- llmintermediate24GB+
Mistral Small 3.2 24B on RX 7900 XTX: Local Private Assistant via llama.cpp-HIP / Ollama (24GB ROCm)
- llmintermediate64GB+
Mistral Small 3.2 24B on M2 Max (64GB): Local Private Assistant via llama.cpp / Ollama on Apple Metal
- llmintermediate48GB+
Mistral Small 3.2 24B on M3 Max (48GB): Local Private Assistant via llama.cpp / Ollama on Apple Metal
- llmintermediate32GB+
Mistral Small 3.2 24B on RTX 5090: Local Private Assistant via llama.cpp / Ollama (32GB)