KoboltCPP settings? Preset?
#2
by
Olafangensan
- opened
I tried a bunch of things, but I cannot get the model to generate anything coherent. Using your q8 gguf.
Olafangensan
changed discussion status to
closed
Never mind, for some reason running it again fixed it. Would still be nice to get some pointers on running it, though.