Falcon-180B-GPTQ / generation_config.json
TheBloke's picture
Add GPTQ 4-bit/None/True, sharded
e2efd96
raw
history blame
113 Bytes
{
"_from_model_config": true,
"bos_token_id": 11,
"eos_token_id": 11,
"transformers_version": "4.33.0"
}