Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

Mixture of Experts

4-bit precision

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

8,537

Full-text search

Active filters: imatrix

mradermacher/Hermes-2-Theta-L3-Euryale-Ties-0.8-70B-i1-GGUF

Updated Aug 2, 2024 • 742 • 3

mradermacher/ArliAI-Llama-3-8B-Formax-v1.0-i1-GGUF

Updated 23 days ago • 147 • 1

mradermacher/L3-8B-Stheno-v3.2-abliterated-i1-GGUF

Updated Aug 2, 2024 • 178 • 4

bartowski/Big-Tiger-Gemma-27B-v1-GGUF

Text Generation • Updated Jul 14, 2024 • 715 • 12

mradermacher/Mahou-1.3d-mistral-7B-i1-GGUF

Updated 20 days ago • 168 • 1

lmstudio-community/mathstral-7B-v0.1-GGUF

Text Generation • Updated Jul 16, 2024 • 4.99k • 9

catbash/Mistral-7B-v0.1-flashback-v2-instruct-Q5_K_M-GGUF

Text Generation • Updated Jul 17, 2024 • 13 • 2

bartowski/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Nov 5, 2024 • 9.21k • 57

bartowski/Arcee-Nova-GGUF

Text Generation • Updated Jul 19, 2024 • 239 • 5

mradermacher/gemma-2-9b-it-SimPO-i1-GGUF

Updated Aug 2, 2024 • 206 • 7

mradermacher/saiga_gemma2_10b-i1-GGUF

Updated 23 days ago • 198 • 3

mradermacher/llama3-8B-DarkIdol-2.3-Uncensored-32K-i1-GGUF

Updated Aug 2, 2024 • 992 • 6

mradermacher/L3-Himerus-Basis.C-13B-i1-GGUF

Updated 23 days ago • 93 • 1

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 29, 2024 • 2.29M • 38

mmnga/Llama-3.1-70B-Instruct-gguf

Updated Jul 24, 2024 • 188 • 2

lmstudio-community/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 28, 2024 • 365 • 37

bartowski/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF

Text Generation • Updated Jul 28, 2024 • 2.28k • 8

lmstudio-community/Phi-3.1-mini-128k-instruct-GGUF

Text Generation • Updated Jul 25, 2024 • 3.54k • 4

mradermacher/lumi-nemo-e2.0-i1-GGUF

Updated Nov 17, 2024 • 12 • 2

mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF

Updated Aug 2, 2024 • 1.45k • 10

mradermacher/Meta-Llama-3.1-Chat-Uncensored-i1-GGUF

Updated Aug 2, 2024 • 229 • 2

mradermacher/Meta-Llama-3.1-13B-Instruct-abliterated-i1-GGUF

Updated Aug 2, 2024 • 384 • 4

bartowski/Gemmasutra-Pro-27B-v1-GGUF

Text Generation • Updated Jul 29, 2024 • 950 • 2

mradermacher/L3-TheGreenLion-8b-SFT-v0.1.2-i1-GGUF

Updated 23 days ago • 55 • 1

mradermacher/G2-DA-Nyxora-27b-V2-i1-GGUF

Updated Aug 2, 2024 • 159 • 1

mradermacher/Nemomix-v0.1-12B-i1-GGUF

Updated 23 days ago • 102 • 2

mradermacher/Nemomix-v4.0-12B-i1-GGUF

Updated Jul 31, 2024 • 141 • 6

mradermacher/Gemmasutra-Pro-27B-v1-i1-GGUF

Updated Aug 2, 2024 • 174 • 1

lmstudio-community/gemma-2-2b-it-GGUF

Text Generation • Updated Jul 31, 2024 • 7.28k • 20

ThomasBaruzier/gemma-2-2b-it-GGUF

Text Generation • Updated Aug 17, 2024 • 281 • 2