Transformers
llama
text-generation-inference

It doesn't follow the conversation

#2
by anon7463435254 - opened

I noticed that it doesn't follow the conversation, not even the previous sentence. I put an example:

chat.PNG

This happens also with LLaMA2 itself, but the interesting thing is that using HF spaces it does not happen (instead it seems very good in keeping the context).

Thanks for the help.

If Johnny has 3 apples and Davey has 2 apples, why don't they just shut up and eat?

Sign up or log in to comment