Liu

Shiweiliuiiiiiii's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

authored a paper 4 days ago

SPAM: Spike-Aware Adam with Momentum Reset for Stable LLM Training

Paper • 2501.06842 • Published 6 days ago • 14

upvoted a paper 5 days ago

SPAM: Spike-Aware Adam with Momentum Reset for Stable LLM Training

Paper • 2501.06842 • Published 6 days ago • 14

commented a paper 5 days ago

SPAM: Spike-Aware Adam with Momentum Reset for Stable LLM Training

Paper • 2501.06842 • Published 6 days ago • 14 •

2

authored a paper 30 days ago

Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN

Paper • 2412.13795 • Published Dec 18, 2024 • 19

upvoted 2 papers about 1 month ago

Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN

Paper • 2412.13795 • Published Dec 18, 2024 • 19

APOLLO: SGD-like Memory, AdamW-level Performance

Paper • 2412.05270 • Published Dec 6, 2024 • 38

updated a model about 2 months ago

Shiweiliuiiiiiii/Llama-3.1-8B-EdgeLLM

Updated Nov 20, 2024

updated 3 models 3 months ago

Shiweiliuiiiiiii/250m-postLN

Updated Oct 25, 2024 • 1

Shiweiliuiiiiiii/250m-preLN

Updated Oct 25, 2024 • 1

Shiweiliuiiiiiii/mixln_1b_6posts

Updated Oct 20, 2024 • 3

upvoted a paper 6 months ago

Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients

Paper • 2407.08296 • Published Jul 11, 2024 • 31