ISTA-DASLab

/

Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16

like 20

Follow

IST Austria Distributed Algorithms and Systems Lab 46

Hi! Sorry if I already posted this elsewhere and can't find it, but it would be really nice to have a decent biomed model with 2-bit quant if you ever have the resources! OpenBioLLM 70B is I think the top right now.

Thanks for doing all of these quants!