no tokenizer.json
no tokenizer.json
There is indeed no tokenizer.json in this repo. There is no tokenizer.json in the repo for the base model I tuned this off of either. While I haven't personally used this unquantized version for inference, I know for a fact it is (or at the very least, was) possible to quantize it.
Which stack are you using that insists such a file is required?
I don't have any plan to quantize or finetune the model, yet, at least. But there's this platform where I want to host the model at and it requires the tokenizer.json in order to run the model, that's why i require the file
Thank you!
could you add it, by any chance?
Since it's missing from the base model as well it will take some effort to track down the proper file. I'll try to get this done during the coming week, though.