I have a question
#2
by
Kyouko-Hatake
- opened
I would like to be able to launch my own GGUF or other model directly with python without using Webui, is this possible?
Maybe this example, can help you out.
https://github.com/machaao/mistral-7b-chatbot