Benjamin Clavié's picture

Benjamin Clavié

bclavie

·

https://ben.clavie.eu

AI & ML interests

None yet

Recent Activity

liked a model about 11 hours ago

nomic-ai/modernbert-embed-base

replied to MoritzLaurer's post about 12 hours ago

Quite excited by the ModernBERT release! 0.15/0.4B small, 2T modern pre-training data and tokenizer with code, 8k context window, great efficient model for embeddings & classification! This will probably be the basis for many future SOTA encoders! And I can finally stop using DeBERTav3 from 2021 :D Congrats @answerdotai, @LightOnIO and collaborators like @tomaarsen ! Paper and models here 👇https://huggingface.co/collections/answerdotai/modernbert-67627ad707a4acbf33c41deb

updated a model 12 days ago

answerdotai/ModernBERT-large

View all activity

Articles

Finally, a Replacement for BERT: Introducing ModernBERT

Organizations

bclavie's activity

upvoted a collection 18 days ago

ModernBERT

Bringing BERT into modernity via both architecture changes and scaling • 3 items • Updated 18 days ago • 116

upvoted a paper 18 days ago

Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference

Paper • 2412.13663 • Published 20 days ago • 119

upvoted a paper about 1 month ago

Reducing the Footprint of Multi-Vector Retrieval with Minimal Performance Impact via Token Pooling

Paper • 2409.14683 • Published Sep 23, 2024 • 10

upvoted a collection 4 months ago

Ruri: Japanese General Text Embeddings

18 items • Updated Sep 13, 2024 • 13