Plans for 70b?

#3
by Delcos - opened

This one works better than any of the others I've tested, including the others here. It gives the least generic responses and seems to avoid repetition even at full context. Any plans for a 70b version or any plans to find someone who can train it?

@Delcos Have you tried the Emerhyst 20B one yet (https://huggingface.co/Undi95/Emerhyst-20B)? If yes, what's your impression of it comparing to this one?

I don't know if it's possible kek, I also don't have the power to try/doing that sadly.

@Delcos Have you tried the Emerhyst 20B one yet (https://huggingface.co/Undi95/Emerhyst-20B)? If yes, what's your impression of it comparing to this one?

This one just seems to get actual conversation better, including Emerhyst. It seems to be able to stay away from generic answers better. As an example I have a character that doesn't speak like the generic AI at all, and out of the 4 here including Em MX was the only one to never give an answer with a word like "assist".
Repetition not being as big of an issue isn't something I can't confirm or know if it's the way I prompt it, or more down to the model.

I don't know if it's possible kek, I also don't have the power to try/doing that sadly.

I forgot this was part of a merge, but if you need GPUs runpod if pretty good for training larger models. Not great for actually using them though.

Sign up or log in to comment