-
-
-
-
-
-
Inference status
Active filters:
web-llm
mlc-ai/Llama-2-70b-chat-hf-q4f16_1-MLC
Updated
•
8
•
2
mlc-ai/Llama-3-8B-Instruct-q4f32_1-MLC
Updated
•
1.23k
•
1
mlc-ai/Llama-3.1-8B-Instruct-q4f16_1-MLC
Updated
•
641
•
2
mlc-ai/Phi-3.5-mini-instruct-q4f16_1-MLC
Updated
•
2.53k
•
3
mlc-ai/Phi-3.5-vision-instruct-q0f16-MLC
Updated
•
2
•
1
mlc-ai/Qwen2.5-3B-Instruct-q4f16_1-MLC
Updated
•
112
•
1
mlc-ai/Qwen2.5-7B-Instruct-q4f16_1-MLC
Updated
•
109
•
2
mlc-ai/Qwen2.5-Coder-1.5B-Instruct-q0f16-MLC
Updated
•
10
•
1
mlc-ai/Qwen2.5-Coder-7B-Instruct-q4f16_1-MLC
Updated
•
160
•
1
mlc-ai/Llama-3.2-3B-Instruct-q4f16_1-MLC
Updated
•
1.08k
•
4
mlc-ai/Llama-3.2-3B-Instruct-q4f32_1-MLC
Updated
•
935
•
2
mlc-ai/Qwen2.5-Coder-32B-Instruct-q4f32_1-MLC
Updated
•
10
•
1
mlc-ai/Llama-2-7b-chat-hf-q4f16_1-MLC
Updated
•
273
•
8
mlc-ai/Llama-2-7b-chat-hf-q4f32_1-MLC
Updated
•
194
•
2
mlc-ai/Mistral-7B-Instruct-v0.2-q4f16_1-MLC
Updated
•
14.6k
•
4
mlc-ai/Llama-2-13b-chat-hf-q4f16_1-MLC
Updated
•
149
•
1
mlc-ai/OpenHermes-2.5-Mistral-7B-q4f16_1-MLC
Updated
•
78
•
1
mlc-ai/NeuralHermes-2.5-Mistral-7B-q4f16_1-MLC
Updated
•
80
•
2
mlc-ai/WizardMath-7B-V1.0-q4f16_1-MLC
mlc-ai/WizardMath-13B-V1.0-q4f16_1-MLC
Updated
•
11
mlc-ai/WizardMath-70B-V1.0-q4f16_1-MLC
Updated
•
20
mlc-ai/RedPajama-INCITE-Chat-3B-v1-q4f16_1-MLC
Updated
•
265
•
2
mlc-ai/RedPajama-INCITE-Chat-3B-v1-q4f32_1-MLC
Updated
•
80
•
2
mlc-ai/WizardMath-7B-V1.1-q4f16_1-MLC
Updated
•
96
mlc-ai/phi-2-q0f16-MLC
Updated
•
21
•
1
mlc-ai/phi-2-q4f16_1-MLC
Updated
•
291
•
2
mlc-ai/phi-1_5-q0f16-MLC
mlc-ai/phi-1_5-q4f16_1-MLC
Updated
•
399
mlc-ai/gpt2-q0f16-MLC
mlc-ai/gpt2-medium-q0f16-MLC