turboderp

/

Llama-3.1-70B-Instruct-exl2

like 17

Hi turboderp, thank you for these quants, already proving useful to me.
Was hoping you might also do the base 70B model. I have 40GB VRAM so 3 to4 bpw works well, with varying room for context.
Thanks either way!!