Which model is recommended for 4080super 16G video memory?
#6
by
decem
- opened
Which model is recommended for 4080super 16G video memory?
Prooooobably not this model considering even at IQ1_M you'd only be able to fit 1/4 of the model on your GPU.. maybe more like an 8b model? Or a Q4 quant of 22B?
Thanks for your reply, it's very helpful to me
decem
changed discussion status to
closed