stabilityai
/

stablelm-2-zephyr-1_6b

Text Generation

Inference Endpoints

Model card Files Files and versions Community

stablelm-2-zephyr-1_6b / tokenizer_config.json

Commit History

Update tokenizer_config.json

3a48bc9
verified

pvduy commited on Jun 3, 2024

fix(tokenizer): set `mode_max_length=4096`

e1520e0
verified

jon-tow commited on May 6, 2024

tmpfix(tokenizer_config): force `GPT2TokenizerFast`

542dce2
verified

jon-tow commited on Apr 9, 2024

update(tokenizer): convert to `GPT2Tokenizer` (#15)

c89d7d1
verified

jon-tow commited on Mar 1, 2024

Upload tokenizer

909ab34
verified

dmayhem93 commited on Jan 19, 2024