Any hope for GGUF..?

#3
by rfega4g43qtgeragergr - opened

Thank you!

This comment has been hidden

I am converting it!! Please wait for hours🙇‍♀️

See there

Faraday.dev says that models are malformed.
Koboldcpp gives an instruction error.

I'm sorry ... I haven't used koboldcpp. The feature support has just been released so you may need the latest version of llama.cpp

try this mradermacher/Llama-3-Aplite-Instruct-4x8B-GGUF

raincandy-u changed discussion status to closed

Sign up or log in to comment