NeverSleep/Lumimaid-v0.2-8B-GGUF CRASH in Koboldcpp
I tested the NeverSleep/Lumimaid-v0.2-12B-GGUF and it loaded just fine in Koboldcpp. I am now testing the 8B model and I get a crash.
This looks like it is stating: the wrong number of tensors where 292 is expected and it is getting 291?
Is there a fix for this?
Download the new Koboldcpp that released a few hours ago. It works with the Llama 3.1 models.
Download the new Koboldcpp that released a few hours ago. It works with the Llama 3.1 models.
Ah I did not see that it was updated today, thank you. Is this model censored?
Same here crashing hard! the new model didnt help
Same here crashing hard! the new model didnt help
Update.
Dunno what you use but update. Model are fine haha
It works now 💪🏽 I must say WOW! I use Lumimaid 8B v0.2 for npc RP in SkyrimVR with Mantella and OMG this is such an upgrade 😍 THANK YOU!
Yeah me too and omg Knock your socks off good!! Who ever made this a.i. should be worshiped as a GOD!! I love you UNDI!!!! What I did in my prompt for Mantella . I edited the prompt and gave directions in a such a way that it could understand. I also edited the bio to reflect this. You usually shouldn't do that.. I wanted fail safe measures.. If you would like to join the mantella discord your welcome to friend me. 334026289021321218 My discord or look up Keionsa. https://discord.gg/M6KETBBM