neuralmagic
/

Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Mistral-7B-Instruct-v0.3-GPTQ-4bit / README.md

Commit History

Update README.md

ed07c8f
verified

mgoin commited on Jun 10, 2024

Update README.md

ca4faba
verified

mgoin commited on May 23, 2024

Update README.md

2ca503f
verified

mgoin commited on May 23, 2024

Update README.md

dc49055
verified

mgoin commited on May 23, 2024

add link to nm-vllm

169e798

Eldar Kurtic commited on May 23, 2024

add nm-vllm perf

bc8ee38

Eldar Kurtic commited on May 23, 2024

Update results

ba1167e

Eldar Kurtic commited on May 23, 2024

Update results

d2809f1

Eldar Kurtic commited on May 23, 2024

Update results

d8f6dae

Eldar Kurtic commited on May 23, 2024

Initial commit

65aebf9

Eldar Kurtic commited on May 23, 2024

initial commit

ab98e3f
verified

ekurtic commited on May 23, 2024