Loss calculation always 0
#24
by
sanipanwala
- opened
Hello,
I'm trying to fine-tune the 34B model but during fine-tuning, I always get a loss 0. While I was able to fine-tune 7B and 13B models but not 34B.
Let me know if I'm overlooking this or please give me suggestions.
Thanks.