license: llama3.1
EXL2 quants of Llama-3.1 8B instruct
3.00 bits per weight3.50 bits per weight4.00 bits per weight4.50 bits per weight5.00 bits per weight6.00 bits per weight8.00 bits per weight
measurement.json