Edit Models filters

Anthropic/hh-rlhf

stanfordnlp/SHP

OpenAssistant/oasst1

tatsu-lab/alpaca

Hello-SimpleAI/HC3

openai/webgpt_comparisons

fka/awesome-chatgpt-prompts

kyujinpy/OpenOrca-KO

maywell/ko_wikidata_QA

openai/summarize_from_feedback

openbmb/UltraFeedback

meta-math/MetaMathQA

openchat/openchat_sharegpt4_dataset

Dahoas/synthetic-instruct-gptj-pairwise

HuggingFaceH4/ultrachat_200k

Intel/orca_dpo_pairs

allenai/ultrafeedback_binarized_cleaned

glaiveai/glaive-function-calling-v2

hkust-nlp/deita-10k-v0

lmsys/chatbot_arena_conversations

PKU-Alignment/PKU-SafeRLHF

gsdf/EasyNegative

nvidia/HelpSteer

Nerfgun3/bad_prompt

Open-Orca/OpenOrca

databricks/databricks-dolly-15k

papluca/language-identification

ColumbiaNLP/FLUTE

JosephusCheung/GuanacoDataset

Salesforce/dialogstudio

alisawuffles/WANLI

demelin/moral_stories

mwong/fever-evidence-related

pietrolesci/nli_fever

tasksource/mmlu

tiiuae/falcon-refinedweb

yizhongw/self_instruct

AmazonScience/massive

DFKI-SLT/few-nerd

GBaker/MedQA-USMLE-4-options

Gustavosta/Stable-Diffusion-Prompts

HuggingFaceFV/finevideo

HuggingFaceH4/ultrafeedback_binarized

Open-Orca/SlimOrca

PhilipMay/stsb_multi_mt

QingyiSi/Alpaca-CoT

TIGER-Lab/MathInstruct

allenai/objaverse

anon8231489123/ShareGPT_Vicuna_unfiltered

argilla/ultrafeedback-binarized-preferences-cleaned

berkeley-nest/Nectar

cardiffnlp/tweet_sentiment_multilingual

cerebras/SlimPajama-627B

codeparrot/github-code

codeparrot/github-code-clean

facebook/belebele

facebook/multilingual_librispeech

kunishou/hh-rlhf-49k-ja

mediabiasgroup/mbib-base

metaeval/reclor

nomic-ai/gpt4all_prompt_generations

roneneldan/TinyStories

stanfordnlp/imdb

tasksource/crowdflower

timdettmers/openassistant-guanaco

togethercomputer/RedPajama-Data-1T

tyqiangz/multilingual-sentiments

unalignment/toxic-dpo-v0.2

webis/Touche23-ValueEval

wikimedia/wikipedia

zeroshot/twitter-financial-news-sentiment

Datasets with no match

mozilla-foundation/common_voice_11_0

mozilla-foundation/common_voice_7_0

teknium/OpenHermes-2.5

cis-lmu/Glot500

microsoft/orca-math-word-problems-200k

allenai/MADLAD-400

m-a-p/CodeFeedback-Filtered-Instruction

bigcode/starcoderdata

oscar-corpus/OSCAR-2109

cognitivecomputations/dolphin-coder

garage-bAInd/Open-Platypus

jondurbin/gutenberg-dpo-v0.1

legacy-datasets/wikipedia

cognitivecomputations/samantha-data

mozilla-foundation/common_voice_13_0

jondurbin/airoboros-2.2.1

jondurbin/airoboros-3.2

lmsys/lmsys-chat-1m

facebook/voxpopuli

jondurbin/truthy-dpo-v0.1

teknium/openhermes

migtissera/Synthia-v1.3

EleutherAI/pile

cognitivecomputations/Dolphin-2.9

ise-uiuc/Magicoder-Evol-Instruct-110K

anthracite-org/kalo-opus-instruct-22k-no-refusal

internlm/Agent-FLAN

Locutusque/function-calling-chatml

Vezora/Tested-22k-Python-Alpaca

mozilla-foundation/common_voice_17_0

nothingiisreal/Reddit-Dirty-And-WritingPrompts

jondurbin/cinematika-v0.1

yahma/alpaca-cleaned

m-a-p/Code-Feedback

HuggingFaceFW/fineweb

Gryphe/Sonnet3.5-Charcard-Roleplay

Epiculous/Synthstruct-Gens-v1.1-Filtered-n-Cleaned

Muennighoff/natural-instructions

Epiculous/SynthRP-Gens-v1.1-Filtered-n-Cleaned

argilla/distilabel-intel-orca-dpo-pairs

mozilla-foundation/common_voice_8_0

huggan/smithsonian_butterflies_subset

codeparrot/apps

ise-uiuc/Magicoder-OSS-Instruct-75K

camel-ai/biology

Gryphe/Sonnet3.5-SlimOrcaDedupCleaned

camel-ai/physics

mlabonne/orpo-dpo-mix-40k

camel-ai/chemistry

HuggingFaceH4/no_robots

grimulkan/LimaRP-augmented

kingbri/PIPPA-shareGPT

OpenAssistant/oasst_top1_2023-08-25

HuggingFaceFW/fineweb-edu

microsoft/orca-agentinstruct-1M-v1

Nopm/Opus_WritingStruct

anthracite-org/nopm_claude_writing_fixed

unalignment/toxic-dpo-v0.1

nvidia/HelpSteer2

HuggingFaceTB/cosmopedia

glaiveai/glaive-code-assistant-v3

allura-org/Celeste-1.x-data-mixture

Gryphe/ChatGPT-4o-Writing-Prompts

allenai/tulu-v2-sft-mixture

jondurbin/airoboros-3.1

AI-MO/NuminaMath-CoT

lemonilia/LimaRP

netcat420/MFANN

HuggingFaceTB/smoltalk

LDJnr/Verified-Camel

jondurbin/airoboros-2.2

derek-thomas/ScienceQA

open-web-math/open-web-math

LDJnr/Pure-Dove

mattpscott/airoboros-summarization

b-mc2/sql-create-context

PygmalionAI/PIPPA

flax-sentence-embeddings/stackexchange_xml

BAAI/Infinity-Instruct

embedding-data/sentence-compression

mozilla-foundation/common_voice_16_1

allenai/tulu-3-sft-mixture

embedding-data/PAQ_pairs

Models

244

Full-text search

Active filters: Anthropic/hh-rlhf

lomahony/pythia-1b-helpful-dpo

Text Generation • Updated May 14, 2024 • 11

lomahony/pythia-2.8b-helpful-dpo

Text Generation • Updated May 14, 2024 • 12

lomahony/pythia-410m-helpful-dpo

Text Generation • Updated May 14, 2024 • 13

lomahony/pythia-70m-helpful-dpo

Text Generation • Updated May 14, 2024 • 12

lomahony/pythia-160m-helpful-dpo

Text Generation • Updated May 14, 2024 • 11

Ray2333/gpt2-large-harmless-reward_model

Text Classification • Updated Jun 2, 2024 • 2.19k • 2

Ray2333/gpt2-large-helpful-reward_model

Text Classification • Updated Jun 2, 2024 • 3.04k • 8

mitultiwari/mistral-7B-instruct-dpo

Text Generation • Updated Feb 13, 2024 • 14 • 2

kevin009/babyllama-v0.6

Text Generation • Updated Mar 4, 2024 • 103 • 1

sethuiyer/mistral-anthropic-adapter-7b

Updated Feb 14, 2024 • 4

honggen/hard_dpo

Text Generation • Updated Mar 7, 2024

Alchan/mpt-7b-chat

Text Generation • Updated Mar 29, 2024 • 14

mightbe/Better-PairRM

Updated Apr 21, 2024 • 60 • 12

voxmenthe/stablelm-2-12b-chat-mlx-4bit

Updated Apr 9, 2024 • 5

Jennny/gpt2-sft

Text Generation • Updated Apr 10, 2024 • 18

DavidAU/PiVoT-0.1-Evil-a-Q6_K-GGUF

Text Generation • Updated Apr 15, 2024 • 4

stabilityai/stablelm-2-12b-chat-GGUF

Updated Apr 20, 2024 • 166 • 1

DavidAU/pythia-1b-helpful-dpo-Q8_0-GGUF

Updated Apr 22, 2024 • 1

titanbot/ct2-int8-mtb-7b-chat

Text Generation • Updated Apr 24, 2024 • 8

MetaAligner/MetaAligner-HH-RLHF-1.1B

Text Generation • Updated May 7, 2024 • 7

MetaAligner/MetaAligner-HH-RLHF-7B

Text Generation • Updated May 7, 2024 • 23 • 1

mradermacher/PiVoT-0.1-Evil-a-GGUF

Updated May 6, 2024 • 28

mradermacher/PiVoT-0.1-Evil-a-i1-GGUF

Updated May 6, 2024 • 41

amirabdullah19852020/interpreting_reward_models

Updated Aug 7, 2024

MetaAligner/MetaAligner-HH-RLHF-13B

Text Generation • Updated May 7, 2024 • 29 • 2

MahmoudMohamed/Reward_Model

Text Classification • Updated May 8, 2024 • 18

kaist-ai/janus-rm-7b

Updated Jun 3, 2024 • 2.5k • 4

nicholasKluge/Aux-RewardModel

Text Classification • Updated Jun 18, 2024 • 18

mradermacher/archangel_sft-kto_llama30b-GGUF

Updated May 31, 2024 • 28 • 2

mradermacher/archangel_sft-kto_llama30b-i1-GGUF

Updated Aug 2, 2024 • 114