I want to use this model on Dify. I am not sure if this setup is correct. How should I configure the endpoint url?
Sorry for the delayed response, but the 7b model seems to be very slow when running so HF CPU, if you still want to try, you can change the model name to llama