self-hosted/ai
§01·compatibility · /check

Llama-2 7B on RTX 3060

runsllmactive30 series12GB VRAM
model
name
Llama-2 7B
slug
llama-2-7b
vertical
llm
status
active
repo
open detail ↗
gpu
name
RTX 3060
slug
rtx-3060
vram
12 GB
series
30
open detail ↗
§02·benchmarks
TaskQuantSpeedVRAMWorksConfidenceSourceVerified
llmQ4_K_M60.2tokens/ssinghajit.com· web2026-05-15