self-hosted/ai
§01·compatibility · /check

gemma 7b on RTX 3060 Ti

runsllmactive30 series8GB VRAM
model
name
gemma 7b
slug
gemma-7b
vertical
llm
status
active
repo
open detail ↗
gpu
name
RTX 3060 Ti
slug
rtx-3060-ti
vram
8 GB
series
30
open detail ↗
§02·benchmarks
TaskQuantSpeedVRAMWorksConfidenceSourceVerified
llm431.95tokens/s8GBdatabasemart.com· web2026-05-15