Quantized GGUF models are available

by MaziyarPanahi - opened Apr 4

Apr 4

Thanks for sharing this model with the community. In order to make it more accessible for gpu-poor users, I have quantized it in GGUF format in case anyone needs it: MaziyarPanahi/medicine-chat-GGUF

AdaptLLM

Owner Apr 4

Thanks for sharing this!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment