self-hosted/ai
§01·compatibility · /check

Qwen2.5 7B on RTX 3060 Ti

runsllmactive30 series8GB VRAM
model
name
Qwen2.5 7B
slug
qwen2-5-7b
vertical
llm
status
active
repo
open detail ↗
gpu
name
RTX 3060 Ti
slug
rtx-3060-ti
vram
8 GB
series
30
open detail ↗
§02·benchmarks
TaskQuantSpeedVRAMWorksConfidenceSourceVerified
llm458.13tokens/s8GBdatabasemart.com· web2026-05-15