turboderp
/

Llama-3.1-8B-Instruct-exl2

Model card Files Files and versions Community

Edit model card

EXL2 quants of Llama-3.1 8B instruct

3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
4.50 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight

measurement.json

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference API

Unable to determine this model's library. Check the docs .