§01·compatibility · /check
Bonsai 27B on RTX 4090
Yes — a published step-by-step recipe documents running Bonsai 27B on the RTX 4090 (24 GB). Community benchmark numbers aren't seeded yet, so measured speed and peak VRAM aren't shown.
✓ recipemultimodalactive40 series24GB VRAM
step-by-step recipe for this pair
Bonsai 27B on RTX 4090: the Full 262K Window Plus the Vision Tower
multimodalintermediate10GB+
§02·benchmarks
No verified benchmarks yet. Be the first to contribute one.
§03·more Bonsai 27B recipes
- multimodalintermediate6GB+
Bonsai 27B on Apple M2 Pro: a 27B Multimodal Model on 16GB Unified Memory via 1-bit GGUF + Metal
- multimodalintermediate6GB+
Bonsai 27B on RX 7900 XTX: a 27B Multimodal Model on AMD via 1-bit GGUF + llama.cpp (ROCm)
- multimodalintermediate6GB+
Bonsai 27B on RTX 5060: the Cheapest Current-Gen Card That Runs a 27B
- multimodalintermediate12GB+
Bonsai 27B on RTX 4070: 100K Context with No KV Compression on 12GB
§04·common questions
Can you run Bonsai 27B on RTX 4090?
Yes — a published step-by-step recipe documents running Bonsai 27B on the RTX 4090 (24 GB). Community benchmark numbers aren't seeded yet, so measured speed and peak VRAM aren't shown.
Are there step-by-step instructions for Bonsai 27B on RTX 4090?
Yes — a step-by-step recipe documents Bonsai 27B on the RTX 4090, linked at the top of this page.