Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

Mixture of Experts

4-bit precision

8-bit precision

AutoTrain Compatible

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

8,494

Full-text search

Active filters: imatrix

mradermacher/Captain-Eris-Diogenes_Twilight-V0.420-12B-i1-GGUF

Updated 8 days ago • 702 • 3

mradermacher/Letta-o1-i1-GGUF

Updated 7 days ago • 574 • 2

mradermacher/saiga_nemo_12b-i1-GGUF

Updated 7 days ago • 675 • 2

mradermacher/14B-Qwen2.5-Freya-x1-i1-GGUF

Updated 6 days ago • 803 • 2

bartowski/HuatuoGPT-o1-72B-GGUF

Text Generation • Updated 5 days ago • 989 • 2

mradermacher/Lamarck-14B-v0.6-rc4-i1-GGUF

Updated 1 day ago • 512 • 2

bartowski/Dolphin3.0-Llama3.2-3B-GGUF

Text Generation • Updated 1 day ago • 738 • 2

flyingfishinwater/good_and_small_models

Updated Nov 11, 2024 • 663 • 2

telosnex/fllama

Updated Sep 25, 2024 • 446 • 6

Nexesenex/MIstral-QUantized-70b_Miqu-1-70b-iMat.GGUF

Updated Oct 12, 2024 • 560 • 69

Lewdiculous/BuRP_7B-GGUF-IQ-Imatrix

Updated May 4, 2024 • 385 • 26

Lewdiculous/Prima-LelantaclesV6.69-7b-GGUF-IQ-Imatrix

Updated Mar 14, 2024 • 17 • 5

Lewdiculous/Prima-LelantaclesV6.3-7b-GGUF-IQ-Imatrix

Updated Mar 14, 2024 • 34 • 4

Lewdiculous/InfinityNexus_9B-GGUF-IQ-Imatrix

Updated Mar 14, 2024 • 81 • 5

InferenceIllusionist/miqu-evil-dpo-iMat-GGUF

Updated Apr 28, 2024 • 182 • 2

bartowski/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated Jun 30, 2024 • 2.18M • 47

bartowski/codegemma-1.1-7b-it-GGUF

Text Generation • Updated May 10, 2024 • 2.68k • 5

mradermacher/Poppy_Porpoise-0.72-L3-8B-i1-GGUF

Updated 22 days ago • 129 • 5

dddump/Japanese-TextGen-Kage-v0.1-2x7B-gguf

Text Generation • Updated May 19, 2024 • 33 • 6

bartowski/Code-Llama-3-8B-GGUF

Text Generation • Updated May 7, 2024 • 265 • 8

backyardai/Fimbulvetr-11B-v2-GGUF

Updated May 22, 2024 • 1.59k • 7

bartowski/Yi-1.5-34B-Chat-GGUF

Text Generation • Updated May 12, 2024 • 477 • 21

lmstudio-community/Yi-1.5-34B-Chat-GGUF

Text Generation • Updated May 13, 2024 • 236 • 9

bartowski/Cat-Llama-3-70B-instruct-GGUF

Text Generation • Updated May 13, 2024 • 530 • 10

bartowski/dolphin-2.9.1-qwen-110b-GGUF

Text Generation • Updated May 15, 2024 • 227 • 2

mradermacher/Ninja-v1-NSFW-RP-i1-GGUF

Updated 22 days ago • 1k • 2

Lewdiculous/L3-8B-Stheno-v3.1-GGUF-IQ-Imatrix

Updated Sep 3, 2024 • 748 • 91

Lewdiculous/rogue-enchantress-32k-7B-GGUF-IQ-Imatrix

Updated May 22, 2024 • 14 • 5

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 2.37M • 72

bartowski/aya-23-8B-GGUF

Text Generation • Updated May 23, 2024 • 3.44k • 44