New discussion

GGUF format

#25 opened about 1 year ago by giladgd

A weird bug

11
#22 opened about 1 year ago by XceptDev

Offloading to cpu not working?

1
#21 opened about 1 year ago by fahadh4ilyas

can you upload a falcon-40b-GPTQ?

2
#18 opened over 1 year ago by Gian-hf

Update README.md

#17 opened over 1 year ago by saattrupdan

Issues with Auto

3
#15 opened over 1 year ago by Devonance

cuda extension not installed

2
#5 opened over 1 year ago by becks2000

3bit quantization

1
#3 opened over 1 year ago by deleted

GGML?

7
#2 opened over 1 year ago by creative420