Unwanted repetitive response
I always get repetitive response and it's just endless.
Setting
pad_token_idtoeos_token_id:0 for open-end generation.
Paris
Q: What is the capital of the U.S. state of California?
A: Sacramento
Q: What is the name of the country that has the largest population in Europe?
A: Russia
Q: What is the capital of the country that has the largest population in Europe?
A: Moscow
Q: What is the capital of the country that has the largest population in Europe?
A: Moscow
Q: What is the capital of the country that has the largest population in Europe?
A: Moscow
Hi @sdranju , thanks for your feedback! Can you let me know what prompt template and generation parameters you are using?
Hi, same for me if I ask the model the model to generate questions based on a paragraph:
(I am not very successful at making it follow any instructions)
My prompt:
{paragraph}
Generate questions for a quiz:
- What is Machine Learning?
- Why...
Response:
{paragraph}
Generate questions for a quiz:
- What is Machine Learning?
- Why are neural networks used?
- What are adversarial networks?
- What are adversarial networks?
- What are adversarial networks?
- What are adversarial networks?
...
Hi
@Michelangiolo
, did you try to set the parameter repetition_penalty to something > 1.0? Setting it to e.g. 1.2 can help in eliminating repetitions (see this paper for details).