Please help me use this model. Thanks!

#2
by taowang1993 - opened

I want to use this model on Dify.
I am not sure if this setup is correct.
How should I configure the endpoint url?

image.png

I want to use this model on Dify.
I am not sure if this setup is correct.
How should I configure the endpoint url?

image.png

Sorry for the delayed response, but the 7b model seems to be very slow when running so HF CPU, if you still want to try, you can change the model name to llama

Sign up or log in to comment