New discussion

How much GPU memory does it need?

1
#6 opened 8 months ago by Har8

Can i run it on CPU?

1
#5 opened 8 months ago by Har8

Error when load the model

3
#3 opened 8 months ago by Har8

Quantized GGUF / EXL2 please?

2
#1 opened 9 months ago by siddhesh22