openchat-3.6-ct2-int8 / config.json
winstxnhdw's picture
feat: add openchat-3.6-ct2-int8 model
bfc7c08 verified
raw
history blame contribute delete
151 Bytes
{
"bos_token": "<|begin_of_text|>",
"eos_token": "<|eot_id|>",
"layer_norm_epsilon": 1e-05,
"multi_query_attention": true,
"unk_token": ""
}