The tokenizer is not custom
#1
by
sgugger
- opened
This removes the trust_remote_code=True
argument from the AutoTokenizer.from_pretrained
call which shouldn't be necessary since the tokenizer is not a custom one (there is no custom code for it in the repo).
Matthijs
changed pull request status to
merged