01-ai/Yi-6B-200K does not appear to have a file named tokenization_yi.py. Checkout 'https://huggingface.co/01-ai/Yi-6B-200K/main' for available files
#4
by
xmy0916
- opened
hello, thanks for your job. it seems you have updated this repo 2 hours ago and rm the file tokenizer_yi.py, i got this error in my code...how can i fix it?
i have fixed it. i copy the tokenization_yi.py to my repo and modify the code refer to tokenizer like:
from tokenization_yi import YiTokenizer
tokenizer = YiTokenizer.from_pretrained()
xmy0916
changed discussion status to
closed