README.md

metadata

license: llama3

Quantized with these parameters:

--bits 4

--group_size 128

--desc_act 1

--damp 0.1

--seqlen 16384

--num_samples 512

Quantization Dataset: Erotiquant XL