Telugu-LLM-Labs

/

Indic-gemma-7b-finetuned-sft-Navarasa-2.0

like 16

I'm translating long english text to telugu by batches.
At some batches the model is start repeating some words/ lines.
How to fix it?

model.generate(**inputs, max_new_tokens=4000, use_cache=True)