Finally, a Replacement for BERT: Introducing ModernBERT
•
443
Benjamin Clavié
bclavie
AI & ML interests
None yet
Recent Activity
liked
a model
about 11 hours ago
nomic-ai/modernbert-embed-base
replied to
MoritzLaurer's
post
about 12 hours ago
Quite excited by the ModernBERT release! 0.15/0.4B small, 2T modern pre-training data and tokenizer with code, 8k context window, great efficient model for embeddings & classification!
This will probably be the basis for many future SOTA encoders! And I can finally stop using DeBERTav3 from 2021 :D
Congrats @answerdotai, @LightOnIO and collaborators like @tomaarsen !
Paper and models here 👇https://huggingface.co/collections/answerdotai/modernbert-67627ad707a4acbf33c41deb
updated
a model
12 days ago
answerdotai/ModernBERT-large
Articles
Organizations
bclavie's activity
liked
a
model
about 11 hours ago
liked
a
model
13 days ago
liked
2
models
17 days ago
liked
2
models
18 days ago
liked
a
model
3 months ago
liked
a
dataset
3 months ago
liked
a
Space
4 months ago
liked
a
model
4 months ago
liked
a
model
5 months ago
liked
a
Space
5 months ago
liked
a
dataset
6 months ago
liked
a
model
8 months ago
liked
a
dataset
10 months ago
liked
a
model
11 months ago
liked
a
model
about 1 year ago
