self-hosted/ai
§01·compatibility · /check

Llama 3.1 8B on RTX 5060 Ti

runsllmactive50 series16GB VRAM
model
name
Llama 3.1 8B
slug
llama-3-1-8b
vertical
llm
status
active
open detail ↗
gpu
name
RTX 5060 Ti
slug
rtx-5060-ti
vram
16 GB
series
50
open detail ↗
§02·benchmarks
TaskQuantSpeedVRAMWorksConfidenceSourceVerified
llmQ41914.5prefill tokens/s16GBinsiderllm.com· manual2026-05-15
llmQ455.5tokens/s16GBinsiderllm.com· manual2026-05-15
§03·related recipes