self-hosted/ai
§01·compatibility · /check

Gemma4 31B on RTX 3090

Yes — Gemma4 31B runs on the RTX 3090 (24 GB). Fastest community-measured generation speed: 34.7 tokens/s.

✓ runsmultimodalactive30 series24GB VRAM
step-by-step recipe for this pair

Gemma 4 31B on RTX 3090: dense 31B local chat via Q4_K_M GGUF in Ollama / llama.cpp

llmintermediate24GB+
model
name
Gemma4 31B
slug
gemma4-31b
vertical
multimodal
status
active
open detail ↗
gpu
name
RTX 3090
slug
rtx-3090
vram
24 GB
series
30
open detail ↗
§02·benchmarks
TaskQuantSpeedVRAMWorksConfidenceSourceVerified
llmQ4_K1155.8prefill tokens/s✓hardware-corner.net· web2026-05-15
llmQ4_K34.7tokens/s✓hardware-corner.net· web2026-05-15
§03·how it was measured
§04·more Gemma4 31B recipes
§05·common questions
Can you run Gemma4 31B on RTX 3090?

Yes — Gemma4 31B runs on the RTX 3090 (24 GB). Fastest community-measured generation speed: 34.7 tokens/s.

Which quantizations have been tested for Gemma4 31B on RTX 3090?

Q4_K — measured in community benchmarks.

How fast is Gemma4 31B on RTX 3090?

Up to 34.7 tokens/s (llm), the fastest community-measured generation speed.

Are there step-by-step instructions for Gemma4 31B on RTX 3090?

Yes — a step-by-step recipe documents Gemma4 31B on the RTX 3090, linked at the top of this page.