dranger003
/

dbrx-instruct-iMat.GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Resources

View closed (0)

can't use llama load gguf model

#6 opened 7 months ago by

How to load this Mdoel in python

#5 opened 7 months ago by

How to use this model in Python

#4 opened 7 months ago by

Very sensitve to any repetition penalty!

#2 opened 8 months ago by

Reuse your `ggml-dbrx-instruct-16x12b-q8_0-imatrix.dat` file?

#1 opened 8 months ago by