self-hosted/ai
§01·compatibility · /check

llama2 13b on RTX 3060 Ti

runsllmactive30 series8GB VRAM
model
name
llama2 13b
slug
llama2-13b
vertical
llm
status
active
repo
open detail ↗
gpu
name
RTX 3060 Ti
slug
rtx-3060-ti
vram
8 GB
series
30
open detail ↗
§02·benchmarks
TaskQuantSpeedVRAMWorksConfidenceSourceVerified
llm49.25tokens/s8GBdatabasemart.com· web2026-05-15