# Tokenizer used for all BLOOM models

Tokenizer information are provided at [https://huggingface.co/bigscience/bloom#preprocessing](https://huggingface.co/bigscience/bloom#preprocessing)

TODO: point to paper once it comes out with extra details on the tokenizer
{"license": "bigscience-bloom-rail-1.0"}
transformers pytorch bloom text-generation license:bigscience-bloom-rail-1.0 autotrain_compatible endpoints_compatible has_space text-generation-inference region:us
TAGS
#transformers #pytorch #bloom #text-generation #license-bigscience-bloom-rail-1.0 #autotrain_compatible #endpoints_compatible #has_space #text-generation-inference #region-us 

# Tokenizer used for all BLOOM models

Tokenizer information are provided at URL

TODO: point to paper once it comes out with extra details on the tokenizer
# Tokenizer used for all BLOOM models

Tokenizer information are provided at URL

TODO: point to paper once it comes out with extra details on the tokenizer
TAGS
#transformers #pytorch #bloom #text-generation #license-bigscience-bloom-rail-1.0 #autotrain_compatible #endpoints_compatible #has_space #text-generation-inference #region-us 
 # Tokenizer used for all BLOOM models

Tokenizer information are provided at URL

TODO: point to paper once it comes out with extra details on the tokenizer