self-hosted/ai
§01·compatibility · /check

Qwen3-8B on RTX 5090

runsllmactive50 series32GB VRAM
model
name
Qwen3-8B
slug
qwen3-8b
vertical
llm
status
active
open detail ↗
gpu
name
RTX 5090
slug
rtx-5090
vram
32 GB
series
50
open detail ↗
§02·benchmarks
TaskQuantSpeedVRAMWorksConfidenceSourceVerified
llmQ4_K11933.4prefill tokens/shardware-corner.net· web2026-05-15
llmQ4_K200.4tokens/shardware-corner.net· web2026-05-15
llmQ4_K_XL145.34tokens/shardware-corner.net· web2026-05-15
§03·related recipes