Pi3141 commited on
Commit
3134e90
1 Parent(s): 94887ec

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -1
README.md CHANGED
@@ -8,4 +8,18 @@ tags:
8
  library_name: adapter-transformers
9
  ---
10
 
11
- # Alpaca Native Enhanced 7B model download for Alpaca.cpp, Llama.cpp, and Dalai
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8
  library_name: adapter-transformers
9
  ---
10
 
11
+ # Alpaca Native Enhanced 7B model download for Alpaca.cpp, Llama.cpp, and Dalai
12
+
13
+ Use this command to run with llama.cpp
14
+ ```sh
15
+ main -m models/ANE-7B/ggml-model-q4_1.bin -n -1 --ctx_size 2048 --batch_size 16 --keep 512 --repeat_penalty 1.0 -t 16 --temp 0.4 --top_k 30 --top_p 0.18 --interactive-first -ins --color -i -r "User:" -f prompts/alpacanativeenhanced.txt
16
+ ```
17
+
18
+ contents of `prompts/alpacanativeenhanced.txt` should be
19
+ ```txt
20
+ You are an AI language model designed to assist the User by answering their questions, offering advice, and engaging in casual conversation in a friendly, helpful, and informative manner. You respond clearly, coherently, and you consider the conversation history.
21
+
22
+ User: Hey, how's it going?
23
+
24
+ Assistant: Hey there! I'm doing great, thank you. What can I help you with today? Let's have a fun chat!
25
+ ```