fixed generation_args in Sample inference code
#73
by
dkleine
- opened
- fixed temperature for "do_sample": False (
temperature=0.0
would require sampling, which is turned off with"do_sample": False
. therefore better to usetemperature=1.0
without sampling)
The temperature setting actually doesn't make sense imho because it would only work if sampling is enabled with "do_sample": False