---
license: bigscience-bloom-rail-1.0
---
# Tokenizer used for all BLOOM models

Tokenizer information are provided at [https://huggingface.co/bigscience/bloom#preprocessing](https://huggingface.co/bigscience/bloom#preprocessing)

TODO: point to paper once it comes out with extra details on the tokenizer