huatuo_AutoGPTQ_7B4bits / generation_config.json
jiangchengchengNLP's picture
Upload generation_config.json
cfc6ae9 verified
raw
history blame
267 Bytes
{
"_from_model_config": true,
"bos_token_id": 1025,
"decoder_start_token_id": 1025,
"do_sample": true,
"eos_token_id": 1024,
"guidance_scale": 1.0,
"min_new_tokens": 50,
"max_length": 2580,
"pad_token_id": 1024,
"transformers_version": "4.38.2"
}