GPT2-SCP-Descriptions / added_tokens.json
Azaghast's picture
add tokenizer
7625054
raw
history blame contribute delete
48 Bytes
{"[BOS]": 50257, "[EOS]": 50258, "[PAD]": 50259}