EXL2 quants of Llama2-70B
2.30 bits per weight2.40 bits per weight2.50 bits per weight2.70 bits per weight3.00 bits per weight3.50 bits per weight4.00 bits per weight4.65 bits per weight6.00 bits per weight
measurement.json
-