Alex Ji commited on
Commit
5ee92cb
1 Parent(s): b50a2ce

add to readme

Browse files
Files changed (1) hide show
  1. README.md +10 -5
README.md CHANGED
@@ -58,13 +58,18 @@ The GGUF model is pruned to 50% using sparseGPT method [sparseGPT](https://githu
58
  </details>
59
  <!-- explaination end -->
60
  from llama_cpp import Llama
 
61
  llm = Llama(model_path="zephyr-7b-beta-pruned50-Q8_0.gguf")
 
62
  output = llm("""
63
- <|system|>
64
- You are a friendly chatbot who always responds in the style of a pirate.</s>
65
- <|user|>
66
- How many helicopters can a human eat in one sitting?</s>
67
- <|assistant|>""")
 
68
  print(output)
 
69
  #
 
70
  <!-- README_GGUF.md-how-to-run start -->
 
58
  </details>
59
  <!-- explaination end -->
60
  from llama_cpp import Llama
61
+
62
  llm = Llama(model_path="zephyr-7b-beta-pruned50-Q8_0.gguf")
63
+
64
  output = llm("""
65
+ <|system|>
66
+ You are a friendly chatbot who always responds in the style of a pirate.</s>
67
+ <|user|>
68
+ How many helicopters can a human eat in one sitting?</s>
69
+ <|assistant|>""")
70
+
71
  print(output)
72
+
73
  #
74
+
75
  <!-- README_GGUF.md-how-to-run start -->