Collection of quantized Llama 3.1 models (8B & 70B versions for now), using bitsandbites.
Farid Saud
fsaudm
AI & ML interests
None yet
Recent Activity
upvoted
a
collection
about 2 hours ago
🤖 Agents
new activity
about 23 hours ago
devansshplu/astrology:this is empty
new activity
5 days ago
deepseek-ai/DeepSeek-V3:vLLM on A100s
Organizations
Collections
1
models
5
fsaudm/Meta-Llama-3.1-70B-Instruct-NF4
Text Generation
•
Updated
•
248
fsaudm/Meta-Llama-3.1-8B-Instruct-NF4
Text Generation
•
Updated
•
284
fsaudm/Reflection-Llama-3.1-70B-Instruct-NF4
Text Generation
•
Updated
•
16
fsaudm/Meta-Llama-3.1-8B-Instruct-INT8
Text Generation
•
Updated
•
64
fsaudm/Meta-Llama-3.1-70B-Instruct-INT8
Text Generation
•
Updated
•
420
datasets
None public yet