You set `add_prefix_space`. The tokenizer needs to be converted from the slow tokenizers
#139
by
Constant8868
- opened
I stucked in the loading process, when I encounter this warning as I load weights from local,
I have the same problem. Has anyone been able to decide?
I think I solved by trying different combinations of "cuda"/"cpu" and bfloat16 or float16