Edit Models filters

Inference status

Misc

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

Misc with no match

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

18

Full-text search

Active filters: higgs

ISTA-DASLab/gemma-2-9b-it-HIGGS-4bit

Text Generation • Updated Dec 6, 2024 • 8

ISTA-DASLab/gemma-2-9b-it-HIGGS-3bit

Text Generation • Updated Dec 6, 2024 • 12

ISTA-DASLab/gemma-2-9b-HIGGS-4bit

Text Generation • Updated Dec 6, 2024 • 9

ISTA-DASLab/gemma-2-9b-HIGGS-3bit

Text Generation • Updated Dec 6, 2024 • 8

ISTA-DASLab/Llama-3.1-8B-HIGGS-4bit

Text Generation • Updated Dec 6, 2024 • 10

ISTA-DASLab/Llama-3.1-8B-HIGGS-3bit

Text Generation • Updated Dec 6, 2024 • 14

ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-4bit

Text Generation • Updated Dec 6, 2024 • 78

ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-3bit

Text Generation • Updated Dec 6, 2024 • 16

ISTA-DASLab/Llama-3.1-70B-Instruct-HIGGS-3bit

Text Generation • Updated Dec 6, 2024 • 13

ISTA-DASLab/Llama-3.1-70B-Instruct-HIGGS-4bit

Text Generation • Updated Dec 6, 2024 • 8

ISTA-DASLab/Llama-3.3-70B-Instruct-HIGGS-4bit

Text Generation • Updated 29 days ago • 46 • 3

ISTA-DASLab/Llama-3.3-70B-Instruct-HIGGS-3bit

Text Generation • Updated Dec 6, 2024 • 17

ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-GPTQ-4bit

Text Generation • Updated 28 days ago • 23

ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-GPTQ-3bit

Text Generation • Updated 28 days ago • 14

ISTA-DASLab/Llama-3.1-8B-HIGGS-GPTQ-3bit

Text Generation • Updated 28 days ago • 13

ISTA-DASLab/Llama-3.1-8B-HIGGS-GPTQ-4bit

Text Generation • Updated 28 days ago • 12

ISTA-DASLab/Llama-3.3-70B-Instruct-HIGGS-GPTQ-4bit

Updated 27 days ago • 12 • 1

PrunaAI/meta-llama-Llama-3.1-8B-Instruct-Higgs-2bit-smashed

Updated 19 days ago • 2