§01·compatibility · /check

Llama 3.1 8B on RTX 3090

? untestedllmactive30 series24GB VRAM

model

name: Llama 3.1 8B
slug: llama-3-1-8b
vertical: llm
status: active
repo: huggingface.co ↗

open detail ↗

gpu

name: RTX 3090
slug: rtx-3090
vram: 24 GB
series: 30

open detail ↗

§02·benchmarks

No verified benchmarks yet. Be the first to contribute one.

§03·related recipes

llmbeginner10GB+
Llama 3.1 8B on RTX 3090: Local Chat via llama.cpp + Unsloth UD-Q4_K_XL GGUF
llmbeginner10GB+
Llama 3.1 8B on RTX 4090: Local Chat via llama.cpp + Unsloth UD-Q4_K_XL GGUF