These are GGUF quants for the following model:
https://huggingface.co/FallenMerick/Smart-Lemon-Cookie-7B
4-bit
6-bit
8-bit
16-bit
Base model