Getting error during safetensors conversion
#1
by
sdranju
- opened
Thrown during validation:do_sample is set to False. However, temperature is set to 0.9 -- this flag is only used in sample-based generation modes.
You should set do_sample=True or unset temperature.
Oh, yeah you can go ahead and remove "temperature" and "top_p" for that matter from the generation_config. I don't believe it's a big deal, it was just something that was added automatically. If it's causingissues with safetensors conversion then I will go ahead and update the file later.