self-hosted/ai
§01·compatibility · /check

gpt-oss 20B on RTX 3090 Ti

Yes — gpt-oss 20B runs on the RTX 3090 Ti (24 GB). Fastest community-measured generation speed: 160.3 tokens/s.

✓ runsllmactive30 series24GB VRAM
step-by-step recipe for this pair

gpt-oss 20B on RTX 3090 Ti: MXFP4 Chat at 160 tok/s via Ollama or vLLM

llmbeginner16GB+
model
name
gpt-oss 20B
slug
gpt-oss-20b
vertical
llm
status
active
open detail ↗
gpu
name
RTX 3090 Ti
slug
rtx-3090-ti
vram
24 GB
series
30
open detail ↗
§02·benchmarks
TaskQuantSpeedVRAMWorksConfidenceSourceVerified
llmMXFP44805.4prefill tokens/s✓hardware-corner.net· web2026-05-15
llmMXFP4160.3tokens/s✓hardware-corner.net· web2026-05-15
§03·how it was measured
  • llmMXFP44805.4 prefill tokens/s

    Prompt processing speed at 4k context

    recorded from hardware-corner.net ↗ · verified 2026-05-15

  • llmMXFP4160.3 tokens/s

    Generation speed at 4k context

    recorded from hardware-corner.net ↗ · verified 2026-05-15

§04·more gpt-oss 20B recipes
§05·common questions
Can you run gpt-oss 20B on RTX 3090 Ti?

Yes — gpt-oss 20B runs on the RTX 3090 Ti (24 GB). Fastest community-measured generation speed: 160.3 tokens/s.

Which quantizations have been tested for gpt-oss 20B on RTX 3090 Ti?

MXFP4 — measured in community benchmarks.

How fast is gpt-oss 20B on RTX 3090 Ti?

Up to 160.3 tokens/s (llm), the fastest community-measured generation speed.

Are there step-by-step instructions for gpt-oss 20B on RTX 3090 Ti?

Yes — a step-by-step recipe documents gpt-oss 20B on the RTX 3090 Ti, linked at the top of this page.