Playground / tokenizer

Commit History

Create tokenizer_config.json
a032292
verified

Yntec commited on

Create special_tokens_map.json
83582ec
verified

Yntec commited on

Upload merges.txt
4c1daa4
verified

Yntec commited on

Rename tokenizer.vocab.json to tokenizer/vocab.json
a732475
verified

Yntec commited on