Repetition issue
#1
by
mpasila
- opened
This model seems to suffer from repetition, like it'll get into loops where it'll just repeat stuff over and over again. The normal Instruct model from MistralAI didn't suffer from the same issue.
What do your sampling and formatting settings look like? I didn't experience repetition much in my testing
Ok so after further testing it seems to be mostly caused by DRY repetition penalty not working, when using regular repetition penalty that seems to fix the issue. Though other models seemed to not have trouble with that for some reason.
mpasila
changed discussion status to
closed