yichunkuo's picture
Update README.md
3cd5652
|
raw
history blame
No virus
479 Bytes
metadata
license: cc-by-4.0

GPTQ quantized stablelm-3b-4e1t

Branch Bits GS Act Order Damp % GPTQ Dataset Seq Len Size ExLlama Desc
main 8 None No 0.01 c4 4096 -- No 8-bit, without Act Order and no grouop size.