GGUF
Not-For-All-Audiences
nsfw
Inference Endpoints
conversational

exception in koboldcpp

#2
by Szarka - opened

i can't quite catch the exception but it immediately shuts down when i try to load it in koboldcpp 1.7.1

NeverSleep org

If you open Koboldcpp in the terminal I can tell you why its happening, if you'd like one on one support cme join https://koboldai.org/discord and we can help you there.

NeverSleep org
edited Jul 27

It's because Koboldcpp didn't updated llama.cpp yet, the fix just got released haha.
But I agree, if you use Kobold don't hesitate to join their discord for more troubleshooting.

alright, thanks! I'll wait for an update then

Sign up or log in to comment