llama-13b-pretrained-sft-do2 / added_tokens.json
dvruette's picture
Upload tokenizer
6da98c9
raw
history blame contribute delete
133 Bytes
{
"<|assistant|>": 32002,
"<|prefix_begin|>": 32000,
"<|prefix_end|>": 32001,
"<|prompter|>": 32003,
"<|system|>": 32004
}