Low-Bit Quantization Favors Undertrained LLMs: Scaling Laws for Quantized LLMs with 100T Training Tokens
Paper
•
2411.17691
•
Published
•
11
Tang Chenxia
tomorrowdawn
·
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
about 1 month ago
Low-Bit Quantization Favors Undertrained LLMs: Scaling Laws for
Quantized LLMs with 100T Training Tokens
upvoted
a
paper
about 2 months ago
Top-nσ: Not All Logits Are You Need
commented
a paper
about 2 months ago
Top-$nσ$: Not All Logits Are You Need
Organizations
