Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

104,149

Full-text search

Active filters: conversational

lmstudio-community/Qwen2.5-Math-7B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 900 • 2

mradermacher/MN-12B-Mag-Mell-R1-i1-GGUF

Updated Sep 18, 2024 • 1.72k • 7

Qwen/Qwen2-7B-Instruct-MLX

Text Generation • Updated Sep 18, 2024 • 231 • 3

TheSkullery/ED-Zephyria-48b

Text Generation • Updated Sep 18, 2024 • 33 • 1

TheSkullery/BA-Zephyria-39b

Text Generation • Updated Sep 18, 2024 • 55 • 2

mradermacher/llama-llava-medtrinity-GGUF

Updated Sep 18, 2024 • 45 • 2

Qwen/Qwen2.5-Coder-1.5B

Text Generation • Updated Nov 18, 2024 • 17.3k • 35

Qwen/Qwen2.5-Coder-1.5B-Instruct

Text Generation • Updated Nov 18, 2024 • 13.4k • 51

Triangle104/Unsloth_Mistral-Small-Instruct-2409-Q4_K_S-GGUF

Updated Dec 1, 2024 • 10 • 1

Triangle104/Unsloth_Mistral-Small-Instruct-2409-Q4_K_M-GGUF

Updated Dec 1, 2024 • 19 • 1

SE6446/Llama-3.1-SuperNova-Lite-Reflection-V1.0

Text Generation • Updated Sep 20, 2024 • 22 • 2

Triangle104/Unsloth_Mistral-Small-Instruct-2409-Q5_K_M-GGUF

Updated Dec 1, 2024 • 12 • 1

cjvt/GaMS-1B-Chat

Text Generation • Updated Sep 27, 2024 • 130 • 2

openbmb/MiniCPM3-4B-GGUF

Updated Sep 18, 2024 • 1.84k • 6

AIDC-AI/Ovis1.6-Gemma2-9B

Image-Text-to-Text • Updated Nov 27, 2024 • 3.97k • 265

Triangle104/Unsloth_Mistral-Small-Instruct-2409-Q6_K-GGUF

Updated Dec 1, 2024 • 18 • 2

Casual-Autopsy/L3-Luna-8B-iMat-GGUF

Updated Sep 18, 2024 • 12 • 2

rasa/cmd_gen_llama_3.1_8b_calm_demo

Text Generation • Updated Sep 26, 2024 • 20 • 2

Qwen/Qwen2.5-Coder-1.5B-Instruct-GGUF

Text Generation • Updated Nov 12, 2024 • 5.56k • 17

bartowski/Cydonia-22B-v1-GGUF

Text Generation • Updated Sep 18, 2024 • 756 • 12

tangledgroup/tangled-llama-33m-32k-base-v0.1

Text Generation • Updated Oct 2, 2024 • 36 • 1

mradermacher/L3-Dark-Planet-8B-V2-Eight-Orbs-Of-Power-GGUF

Updated Sep 18, 2024 • 24 • 2

THUdyh/Oryx-7B

Text Generation • Updated Sep 25, 2024 • 161 • 11

bartowski/Qwen2.5-Math-72B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 845 • 2

lmstudio-community/Qwen2.5-Math-72B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 11.7k • 2

MaziyarPanahi/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • Updated Sep 18, 2024 • 2.33M • 2

mlx-community/Qwen2.5-0.5B-Instruct-4bit

Text Generation • Updated Sep 18, 2024 • 225 • 2

bartowski/Qwen2.5-Math-1.5B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 419 • 1

xiaoheiqaq/Aya-v0.2-Q4_K_M-GGUF

Updated Sep 20, 2024 • 72 • 1

mlx-community/Qwen2.5-14B-Instruct-8bit

Text Generation • Updated Sep 18, 2024 • 68 • 2