GGUF versions?
This looks interesting @TheBloke
I know a few people who also might be willing to convert this to GGUF, I cannot right now I am not home. @Felladrin @afrideva
🙋 I'm available, let me take this one!
oh man! so sorry! Should have checked here before: https://huggingface.co/MaziyarPanahi/TinyMistral-248M-v2.5-Instruct-GGUF
Sorry I created confusion above.
Also, I am confused is Sebastian @Locutusque thebloke? (because there is not much activity going on with thebloke but sebastian is responding quickly).
oh man! so sorry! Should have checked here before: https://huggingface.co/MaziyarPanahi/TinyMistral-248M-v2.5-Instruct-GGUF
I have an easy way to check
In search bar (of hugging face) just type complete name of model with gguf all existing ones appear, you don't have to look into specific repos to find them.
Sorry I created confusion above.
Also, I am confused is Sebastian @Locutusque thebloke? (because there is not much activity going on with thebloke but sebastian is responding quickly).
Nope we are completely different people. Think about it, he has 14,000 followers, and his inbox is probably in the thousands. I'm not surprised he isn't responding.