Rename tokenizer/tokenizer_vocab.json to tokenizer/vocab.json 6b47e00 verified pt-sk commited on May 19, 2024
Rename tokenizer/tokenizer_tokenizer_config.json to tokenizer/tokenizer_config.json a5f3d50 verified pt-sk commited on May 19, 2024
Rename tokenizer/tokenizer_special_tokens_map.json to tokenizer/special_tokens_map.json 6c0a65f verified pt-sk commited on May 19, 2024
Rename tokenizer/tokenizer_merges.txt to tokenizer/merges.txt 4e4961b verified pt-sk commited on May 19, 2024