How did you make these weights?

#1
by adatkins - opened

How did you make these weights? Did you use a particular script based on PyTorch and BitsAndBytes?

Unsloth AI org

How did you make these weights? Did you use a particular script based on PyTorch and BitsAndBytes?

We used bitsandbytes yes!

Thanks @shimmyshimmer :) Is this script on GitHub anywhere? Are you able to share it? I have older hardware but I would still like to try to produce these weights.

Sign up or log in to comment