gpt2-detox / added_tokens.json
pansamuel's picture
Upload tokenizer
3893932 verified
raw
history blame contribute delete
75 Bytes
{
"<|pad|>": 50259,
"<|startoftext|>": 50257,
"<|unknown|>": 50258
}