tokenizer.json typo

#1
by robeyh - opened

Seems like there's a typo in tokenizer.json: https://huggingface.co/mistralai/Mixtral-8x22B-Instruct-v0.1/discussions/6

Might be good to correct it early.

{
  "id": 8,
  "content": "[TOOL_RESULT]",
  "single_word": false,
  "lstrip": false,
  "rstrip": false,
  "normalized": true,
  "special": true
},

Thanks, I've updated it.

turboderp changed discussion status to closed

Sign up or log in to comment