Edit Models filters

Model Tree

Qwen/Qwen2.5-7B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

124

Full-text search

Active filters: Qwen/Qwen2.5-7B-Instruct

DrNicefellow/Qwen2.5-7B-Instruct-8.0bpw-h8-exl2

Updated Sep 20, 2024 • 6 • 1

DrNicefellow/Qwen2.5-7B-Instruct-7.0bpw-exl2

Updated Sep 20, 2024 • 4

DrNicefellow/Qwen2.5-7B-Instruct-6.0bpw-exl2

Updated Sep 20, 2024 • 1

DrNicefellow/Qwen2.5-7B-Instruct-5.0bpw-exl2

Updated Sep 20, 2024 • 5

DrNicefellow/Qwen2.5-7B-Instruct-2.0bpw-exl2

Updated Sep 20, 2024 • 3

DrNicefellow/Qwen2.5-7B-Instruct-1.0bpw-exl2

Updated Sep 20, 2024 • 1

DrNicefellow/Qwen2.5-7B-Instruct-5.5bpw-exl2

Updated Sep 20, 2024 • 3

DrNicefellow/Qwen2.5-7B-Instruct-4.5bpw-exl2

Updated Sep 20, 2024 • 4

raaedk/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 21, 2024 • 4

WSDW/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 21, 2024 • 1 • 1

mukel/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 27, 2024 • 7

idasummer/Qwen2.5-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Sep 24, 2024 • 3

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-256-woft

Updated Nov 18, 2024 • 5

QuantFactory/Qwen2.5-7B-Instruct-abliterated-v2-GGUF

Text Generation • Updated Sep 25, 2024 • 238 • 1

mradermacher/Qwen2.5-7B-Instruct-GGUF

Updated Oct 11, 2024 • 380 • 2

mradermacher/Qwen2.5-7B-Instruct-i1-GGUF

Updated Oct 11, 2024 • 341 • 1

aswqazx/Qwen2.5-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Sep 27, 2024 • 5

Kondara/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 27, 2024 • 1

Kondara/Qwen2.5-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 28, 2024 • 8

VPTQ-community/Qwen2.5-7B-Instruct-v16-k65536-65536-woft

Updated Nov 18, 2024 • 15 • 1

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-65536-woft

Updated Nov 18, 2024 • 4

VPTQ-community/Qwen2.5-7B-Instruct-v8-k256-256-woft

Updated Nov 18, 2024 • 11

VPTQ-community/Qwen2.5-7B-Instruct-v8-k65536-0-woft

Updated Nov 18, 2024 • 14

mashima/Qwen2.5-7B-Instruct-Q8_0-GGUF

Text Generation • Updated Oct 1, 2024

QuantFactory/Replete-LLM-V2.5-Qwen-7b-GGUF

Updated Oct 2, 2024 • 11 • 1

jacobcarajo/Qwen2.5-7B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 2, 2024

redhat6/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 4, 2024 • 2

turingevo/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 4, 2024 • 5

Jeethu/Qwen2.5-7B-Instruct-PLLM

Text Generation • Updated Oct 8, 2024

TheRains/Qwen2.5-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 9, 2024 • 1