jais quantization

#1
by Jmyuse - opened

Great job! And how did you quantize the jais to 4-bit?

Using bitsandbytes

Sign up or log in to comment