Examples dataset used for GPTQ Calibration

#4
by bullerwins - opened

Hi!

Could you provide what dataset was use for the model.quantize(examples) calibration?

Hugging Quants org

Hi here @bullerwins , sorry for the delay, there's a section in the README.md on how to reproduce the quantization.

In this case we used Salesforce/wikitext but you could use any other dataset, such as e.g. HuggingFaceTB/cosmopedia.

alvarobartt changed discussion status to closed

Sign up or log in to comment