2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining
Paper
•
2501.00958
•
Published
•
82
Articoli PHD
-
-
CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings
Paper • 2501.01257 • Published • 41 -
Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Models
Paper • 2501.01423 • Published • 32 -
REDUCIO! Generating 1024times1024 Video within 16 Seconds using Extremely Compressed Motion Latents
Paper • 2411.13552 • Published -
Generative Modeling with Explicit Memory
Paper • 2412.08781 • Published -
CLEAR: Conv-Like Linearization Revs Pre-Trained Diffusion Transformers Up
Paper • 2412.16112 • Published • 21 -
TinyFusion: Diffusion Transformers Learned Shallow
Paper • 2412.01199 • Published • 14 -
Efficient Scaling of Diffusion Transformers for Text-to-Image Generation
Paper • 2412.12391 • Published -
ASGDiffusion: Parallel High-Resolution Generation with Asynchronous Structure Guidance
Paper • 2412.06163 • Published -
On the Surprising Effectiveness of Attention Transfer for Vision Transformers
Paper • 2411.09702 • Published • 1 -
Four-Plane Factorized Video Autoencoders
Paper • 2412.04452 • Published -
SoftVQ-VAE: Efficient 1-Dimensional Continuous Tokenizer
Paper • 2412.10958 • Published -
Nested Diffusion Models Using Hierarchical Latent Priors
Paper • 2412.05984 • Published -
ScaleKD: Strong Vision Transformers Could Be Excellent Teachers
Paper • 2411.06786 • Published -
FlexDiT: Dynamic Token Density Control for Diffusion Transformer
Paper • 2412.06028 • Published -
Phi-4 Technical Report
Paper • 2412.08905 • Published • 97 -
TÜLU 3: Pushing Frontiers in Open Language Model Post-Training
Paper • 2411.15124 • Published • 58 -
Training and Evaluating Language Models with Template-based Data Generation
Paper • 2411.18104 • Published • 3 -
Fox-1 Technical Report
Paper • 2411.05281 • Published • 1 -
ALMA: Alignment with Minimal Annotation
Paper • 2412.04305 • Published -
Training Data for Large Language Model
Paper • 2411.07715 • Published -
TransformLLM: Adapting Large Language Models via LLM-Transformed Reading Comprehension Text
Paper • 2410.21479 • Published -
TinyLLaVA: A Framework of Small-scale Large Multimodal Models
Paper • 2402.14289 • Published • 19 -
TinyLlama: An Open-Source Small Language Model
Paper • 2401.02385 • Published • 90 -
TinyLLM: Learning a Small Student from Multiple Large Language Models
Paper • 2402.04616 • Published -
TinyEmo: Scaling down Emotional Reasoning via Metric Projection
Paper • 2410.07062 • Published • 3 -
LLaVA-MoD: Making LLaVA Tiny via MoE Knowledge Distillation
Paper • 2408.15881 • Published • 21 -
Chinese Tiny LLM: Pretraining a Chinese-Centric Large Language Model
Paper • 2404.04167 • Published • 12 -
Rethinking Optimization and Architecture for Tiny Language Models
Paper • 2402.02791 • Published • 12 -
TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones
Paper • 2312.16862 • Published • 30 -
ProgCo: Program Helps Self-Correction of Large Language Models
Paper • 2501.01264 • Published • 23 -
GReaTer: Gradients over Reasoning Makes Smaller Language Models Strong Prompt Optimizers
Paper • 2412.09722 • Published • 5 -
Forest-of-Thought: Scaling Test-Time Compute for Enhancing LLM Reasoning
Paper • 2412.09078 • Published -
AlphaVerus: Bootstrapping Formally Verified Code Generation through Self-Improving Translation and Treefinement
Paper • 2412.06176 • Published -
MC-NEST -- Enhancing Mathematical Reasoning in Large Language Models with a Monte Carlo Nash Equilibrium Self-Refine Tree
Paper • 2411.15645 • Published -
PerfCodeGen: Improving Performance of LLM Generated Code with Execution Feedback
Paper • 2412.03578 • Published -
Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervision
Paper • 2411.16579 • Published • 2 -
Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference
Paper • 2412.13663 • Published • 119 -
AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation Framework
Paper • 2308.08155 • Published • 3 -
Virgo: A Preliminary Exploration on Reproducing o1-like MLLM
Paper • 2501.01904 • Published • 12 -
VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction
Paper • 2501.01957 • Published • 20 -
SDPO: Segment-Level Direct Preference Optimization for Social Agents
Paper • 2501.01821 • Published • 10 -
VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generation
Paper • 2412.21059 • Published • 11 -
Graph Generative Pre-trained Transformer
Paper • 2501.01073 • Published • 9 -
LUSIFER: Language Universal Space Integration for Enhanced Multilingual Embeddings with Large Language Models
Paper • 2501.00874 • Published • 7 -
BoxingGym: Benchmarking Progress in Automated Experimental Design and Model Discovery
Paper • 2501.01540 • Published • 4 -
Benchmarking Llama2, Mistral, Gemma and GPT for Factuality, Toxicity, Bias and Propensity for Hallucinations
Paper • 2404.09785 • Published -
Gemma 2: Improving Open Language Models at a Practical Size
Paper • 2408.00118 • Published • 76