Transformers
GGUF
English
llama
text-generation-inference
unsloth
Inference Endpoints
conversational
codelion commited on
Commit
be580c0
1 Parent(s): 1b6ead3

(Trained with Unsloth)

Browse files
Files changed (1) hide show
  1. Modelfile +12 -0
Modelfile ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ FROM ./patched-codes/patched-phi-3.5-gguf/unsloth.F16.gguf
3
+ TEMPLATE """{{ if .System }}<|system|>
4
+ {{ .System }}<|end|>
5
+ {{ end }}{{ if .Prompt }}<|user|>
6
+ {{ .Prompt }}<|end|>
7
+ {{ end }}<|assistant|>
8
+ {{ .Response }}<|end|>
9
+ """
10
+ PARAMETER stop "<|end|>"
11
+ PARAMETER stop "<|user|>"
12
+ PARAMETER stop "<|assistant|>"