ModernBERT/tulu_flan
Updated
Bert ... but new
non-profit
AI & ML interests
None defined yet.
Recent Activity
ModernBERT's activity
orionweller
updated
a
dataset
about 6 hours ago
Post
2477
That didn't take long! Nomic AI has finetuned the new ModernBERT-base encoder model into a strong embedding model for search, classification, clustering and more!
Details:
🤖 Based on ModernBERT-base with 149M parameters.
📊 Outperforms both nomic-embed-text-v1 and nomic-embed-text-v1.5 on MTEB!
🏎️ Immediate FA2 and unpacking support for super efficient inference.
🪆 Trained with Matryoshka support, i.e. 2 valid output dimensionalities: 768 and 256.
➡️ Maximum sequence length of 8192 tokens!
2️⃣ Trained in 2 stages: unsupervised contrastive data -> high quality labeled datasets.
➕ Integrated in Sentence Transformers, Transformers, LangChain, LlamaIndex, Haystack, etc.
🏛️ Apache 2.0 licensed: fully commercially permissible
Try it out here: nomic-ai/modernbert-embed-base
Very nice work by Zach Nussbaum and colleagues at Nomic AI.
Details:
🤖 Based on ModernBERT-base with 149M parameters.
📊 Outperforms both nomic-embed-text-v1 and nomic-embed-text-v1.5 on MTEB!
🏎️ Immediate FA2 and unpacking support for super efficient inference.
🪆 Trained with Matryoshka support, i.e. 2 valid output dimensionalities: 768 and 256.
➡️ Maximum sequence length of 8192 tokens!
2️⃣ Trained in 2 stages: unsupervised contrastive data -> high quality labeled datasets.
➕ Integrated in Sentence Transformers, Transformers, LangChain, LlamaIndex, Haystack, etc.
🏛️ Apache 2.0 licensed: fully commercially permissible
Try it out here: nomic-ai/modernbert-embed-base
Very nice work by Zach Nussbaum and colleagues at Nomic AI.
rbiswasfc
authored
a
paper
17 days ago
ohallstrom
authored
a
paper
18 days ago
bwarner
authored
a
paper
18 days ago
orionweller
authored
3
papers
18 days ago
NohTow
authored
2
papers
18 days ago
orionweller
authored
4
papers
18 days ago
Defending Against Poisoning Attacks in Open-Domain Question Answering
Paper
•
2212.10002
•
Published
Learning to Reason via Program Generation, Emulation, and Search
Paper
•
2405.16337
•
Published
CLERC: A Dataset for Legal Case Retrieval and Retrieval-Augmented Analysis Generation
Paper
•
2406.17186
•
Published
•
1
Promptriever: Instruction-Trained Retrievers Can Be Prompted Like Language Models
Paper
•
2409.11136
•
Published
•
22
tomaarsen
authored
a
paper
18 days ago
NohTow
authored
a
paper
18 days ago
orionweller
authored
a
paper
18 days ago
staghado
authored
a
paper
18 days ago
bclavie
authored
a
paper
18 days ago
bclavie
authored
a
paper
about 1 month ago