how to get tokenizer.model

#13
by waleking - opened

Hello, thanks for your work!
I'm trying to use exllamav2 but it needs tokenizer.model. How can I get it from tokenizer.json and tokenizer_config.json? Thanks!

Sign up or log in to comment