self-hosted/ai
§01·compatibility · /check

Qwen3 32B on RTX 5090

✓ runsllmactive50 series32GB VRAM
model
name
Qwen3 32B
slug
qwen3-32b
vertical
llm
status
active
repo
huggingface.co ↗
open detail ↗
gpu
name
RTX 5090
slug
rtx-5090
vram
32 GB
series
50
open detail ↗
§02·benchmarks
TaskQuantSpeedVRAMWorksConfidenceSourceVerified
llmQ4_K2931.3prefill tokens/s✓hardware-corner.net· web2026-05-15
llmQ4_K61.4tokens/s✓hardware-corner.net· web2026-05-15
llmQ4_K_XL50.92tokens/s✓hardware-corner.net· web2026-05-15
§03·related recipes