Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
arxiv:
2309.05516
4-bit precision
custom_code
AutoTrain Compatible
Inference Endpoints
text-generation-inference
Misc with no match
Eval Results
Merge
8-bit precision
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
92
Full-text search
Edit filters
Sort: Trending
Active filters:
2309.05516
Clear all
OPEA/DeepSeek-V3-int4-sym-gptq-inc
Updated
about 13 hours ago
•
419
•
10
OPEA/DeepSeek-V2.5-1210-int4-sym-inc
Updated
about 21 hours ago
•
66
•
7
Intel/Phi-3-mini-4k-instruct-int4-inc
Updated
Jul 4, 2024
•
4
Intel/opt-1.3b-int4-inc-recipe
Updated
Nov 6, 2024
•
1
Intel/Phi-3-mini-128k-instruct-int4-inc-recipe
Updated
Nov 8, 2024
•
1
Intel/Qwen2-1.5B-Instuct-int4-inc
Text Generation
•
Updated
Jun 6, 2024
•
23
•
1
Intel/Qwen2.5-0.5B-Instruct-int4-inc
Updated
Oct 10, 2024
•
1
Intel/Qwen2.5-1.5B-Instruct-int4-inc
Updated
Oct 10, 2024
•
1
OPEA/Llama-3.2-11B-Vision-Instruct-int4-sym-inc
Updated
14 days ago
•
99
•
2
OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc
Updated
15 days ago
•
29
•
3
tonyshark/deepseek-v3-int4-cpu
Updated
4 days ago
•
284
•
1
Intel/neural-chat-7b-v3-1-int4-inc
Text Generation
•
Updated
Aug 26, 2024
•
18
•
2
Intel/neural-chat-7b-v3-3-int4-inc
Text Generation
•
Updated
Aug 26, 2024
•
15
•
3
Intel/Mistral-7B-v0.1-int4-inc
Text Generation
•
Updated
May 31, 2024
•
269
•
4
Intel/falcon-7b-int4-inc
Text Generation
•
Updated
Aug 26, 2024
•
14
Intel/chatglm2-6b-int4-inc
Updated
Jul 4, 2024
Intel/Qwen1.5-0.5B-Chat-int4-inc
Updated
Jul 4, 2024
Intel/chatglm3-6b-int4-inc
Updated
Jul 4, 2024
Intel/Baichuan2-7B-Chat-int4-inc
Updated
Jul 4, 2024
Intel/Baichuan2-13B-Chat-int4-inc
Updated
Jul 4, 2024
•
1
Intel/SOLAR-10.7B-Instruct-v1.0-int4-inc
Updated
Jul 4, 2024
•
1
Intel/gpt-j-6b-int4-inc
Updated
Jul 4, 2024
Intel/gpt-neox-20b-int4-inc
Updated
Jul 4, 2024
Intel/mpt-7b-chat-int4-inc
Updated
Jul 4, 2024
Intel/falcon-7b-instruct-int4-inc
Updated
Jul 4, 2024
Intel/bloom-7b1-int4-inc
Updated
Jul 4, 2024
Intel/opt-13b-int4-inc
Updated
Jul 4, 2024
Intel/Llama-2-7b-chat-hf-int4-inc
Updated
Jul 4, 2024
Intel/Meta-Llama-3-8B-Instruct-int4-inc
Updated
Jul 4, 2024
Intel/Qwen1.5-7B-Chat-int4-inc
Updated
Jul 4, 2024
Previous
1
2
3
4
Next