Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

Carbon Emissions

Misc with no match

8-bit precision

text-embeddings-inference

Mixture of Experts

Models

174

Full-text search

Active filters: llama-3.1

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 490k • 62

vicgalle/Configurable-Llama-3.1-8B-Instruct

Text Generation • Updated Jul 24, 2024 • 4.78k • 15

hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7, 2024 • 47k • 22

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7, 2024 • 74k • 21

akjindal53244/Llama-3.1-Storm-8B

Text Generation • Updated Dec 5, 2024 • 11.4k • 169

mukaj/Llama-3.1-Hawkish-8B

Text Generation • Updated Oct 26, 2024 • 315 • 41

mradermacher/Llama-3.1-8B-Instruct-Zeus-GGUF

Updated Dec 1, 2024 • 125 • 1

mradermacher/Llama-3.1-8B-Instruct-Zeus-i1-GGUF

Updated Dec 1, 2024 • 296 • 1

mradermacher/ZEUS-8B-V2-GGUF

Updated Dec 3, 2024 • 97 • 2

mradermacher/ZEUS-8B-V2-i1-GGUF

Updated Dec 3, 2024 • 275 • 2

mradermacher/ZEUS-8B-V2L2-GGUF

Updated Dec 3, 2024 • 60 • 1

mradermacher/ZEUS-8B-V2L1-GGUF

Updated Dec 3, 2024 • 11 • 1

mradermacher/ZEUS-8B-V2L2-i1-GGUF

Updated Dec 3, 2024 • 56 • 1

T145/KRONOS-8B-V1-P1

Text Generation • Updated Dec 5, 2024 • 33 • 1

mradermacher/KRONOS-8B-V1-P1-GGUF

Updated Dec 6, 2024 • 9 • 1

T145/KRONOS-8B-V1-P3

Text Generation • Updated Dec 6, 2024 • 83 • 1

mradermacher/KRONOS-8B-V1-P3-GGUF

Updated Dec 6, 2024 • 64 • 1

T145/ZEUS-8B-V2-abliterated

Text Generation • Updated 7 days ago • 53 • 1

mradermacher/ZEUS-8B-V2-abliterated-GGUF

Updated 7 days ago • 318 • 1

mradermacher/ZEUS-8B-V2-abliterated-i1-GGUF

Updated 6 days ago • 540 • 1

hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation • Updated Sep 13, 2024 • 549 • 37

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 177k • 92

hugging-quants/Meta-Llama-3.1-405B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7, 2024 • 350 • 16

hugging-quants/Meta-Llama-3.1-405B-BNB-NF4

Text Generation • Updated Sep 16, 2024 • 71 • 2

hugging-quants/Meta-Llama-3.1-405B-Instruct-BNB-NF4

Text Generation • Updated Sep 16, 2024 • 1.02k • 5

hugging-quants/Meta-Llama-3.1-8B-Instruct-BNB-NF4

Text Generation • Updated Aug 8, 2024 • 3.44k • 7

hugging-quants/Meta-Llama-3.1-8B-BNB-NF4

Text Generation • Updated Aug 8, 2024 • 263

ModelCloud/Meta-Llama-3.1-8B-Instruct-gptq-4bit

Text Generation • Updated Jul 29, 2024 • 210 • 3

brittlewis12/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 27, 2024 • 35 • 1

ModelCloud/Meta-Llama-3.1-8B-gptq-4bit

Text Generation • Updated Jul 26, 2024 • 32