Text Generation
Transformers
PyTorch
mosaic_gpt
custom_code
mpt-1b-redpajama-200b / special_tokens_map.json
daking's picture
Upload tokenizer
9a5ea10
raw
history blame
99 Bytes
{
"bos_token": "<|endoftext|>",
"eos_token": "<|endoftext|>",
"unk_token": "<|endoftext|>"
}