Edit Models filters

Inference status

Misc

text-generation-inference

AutoTrain Compatible

Inference Endpoints

Misc with no match

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

80

Full-text search

Active filters: 7-bit

DrNicefellow/Qwen-QwQ-32B-Preview-7.0bpw-exl2

Updated Nov 28, 2024 • 1

Dracones/Qwen2.5-32B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 1, 2024 • 9

Dracones/Qwen2.5-Coder-32B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 1, 2024 • 15

Dracones/Athene-V2-Chat_exl2_7.0bpw

Text Generation • Updated 24 days ago • 13

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 2, 2024 • 7

Dracones/Qwen2.5-72B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 2, 2024 • 10

Dracones/QwQ-32B-Preview_exl2_7.0bpw

Text Generation • Updated Dec 3, 2024 • 7

BigHuggyD/TheDrummer_Behemoth-123B-v1.2_exl2_7.0bpw_h8

Updated Dec 3, 2024 • 5

Dracones/Evathene-v1.3_exl2_7.0bpw

Text Generation • Updated Dec 3, 2024 • 9

SicariusSicariiStuff/Impish_Mind_8B-7.0bpw

Updated Dec 5, 2024 • 2

DrNicefellow/QwQ-32B-Preview-abliterated-7.0bpw-exl2

Updated Dec 6, 2024 • 4

Dracones/Llama-3.3-70B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 7, 2024 • 12

Dracones/L3.3-70B-Euryale-v2.3_exl2_7.0bpw

Text Generation • Updated 28 days ago • 12

Dracones/EVA-LLaMA-3.33-70B-v0.0_exl2_7.0bpw

Text Generation • Updated 27 days ago • 9

Dracones/72B-Qwen2.5-Kunou-v1_exl2_7.0bpw

Text Generation • Updated 22 days ago • 12

FrenzyBiscuit/Skyfall-39B-v1-7.0bpw-h8-exl2

Updated 21 days ago • 7

FrenzyBiscuit/Anubis-70B-v1-7.0bpw-h8-exl2

Updated 17 days ago • 19

Dracones/Anubis-70B-v1_exl2_7.0bpw

Text Generation • Updated 14 days ago • 11

Dracones/QVQ-72B-Preview_exl2_7.0bpw

Image-Text-to-Text • Updated 13 days ago • 2

Dracones/Evayale-v1.0_exl2_7.0bpw

Text Generation • Updated 1 day ago