Edit Models filters

Model Tree

meta-llama/Llama-3.1-8B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

302

Full-text search

Active filters: meta-llama/Llama-3.1-8B-Instruct

VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-4096-woft

Updated Nov 18, 2024 • 14

VPTQ-community/Meta-Llama-3.1-8B-Instruct-v8-k65536-256-woft

Updated Nov 18, 2024 • 245

nm-testing/Meta-Llama-3.1-8B-Instruct-FP8-hf

Text Generation • Updated Sep 24, 2024 • 466

jc132/Home-Llama-v2.0-GGUF

Updated Oct 26, 2024 • 150

jxtngx/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25, 2024

QuantFactory/Vikhr-Llama3.1-8B-Instruct-R-21-09-24-GGUF

Updated Sep 25, 2024 • 183 • 1

rachelkluu/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25, 2024 • 1

lodm94/Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 26, 2024 • 1

hungun/Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 28, 2024 • 1

VPTQ-community/Meta-Llama-3.1-8B-Instruct-v12-k65536-4096-woft

Updated Nov 26, 2024 • 533 • 2

m2wws/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 29, 2024 • 2

hoorang/Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Sep 30, 2024 • 5

stramzik/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 2, 2024 • 2

jacobcarajo/Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 2, 2024 • 2

arzuhussein/atllama

Updated Oct 4, 2024 • 1 • 3

hongphucpham/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 7, 2024

cmchenry66/Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 8, 2024

josiahdavis/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 8, 2024

BitStreamX/Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 8, 2024

Jeethu/Meta-Llama-3.1-8B-Instruct-PLLM

Text Generation • Updated Oct 8, 2024

QuantFactory/Llama3.1-8B-Esper2-GGUF

Text Generation • Updated Oct 9, 2024 • 25 • 1

DaraV/LLaMA-3.1-8B-Instruct-INT4-GPTQ

Updated Oct 11, 2024 • 3

sheldonrobinson/Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • Updated Oct 11, 2024

mav23/Llama3.1-8B-Chinese-Chat-GGUF

Text Generation • Updated Oct 12, 2024 • 52 • 1

RaselAntor/SKAANT2

Updated Oct 22, 2024

mav23/Llama-3.1-SuperNova-Lite-GGUF

Updated Oct 12, 2024 • 46

AndoShy/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 13, 2024

mav23/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF

Updated Oct 13, 2024 • 22

RaselAntor/SKANNTlexi

Updated Oct 22, 2024 • 1

RaselAntor/Final

Updated Oct 22, 2024