TheBloke commited on
Commit
b502758
1 Parent(s): 232ce8d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -7
README.md CHANGED
@@ -42,9 +42,10 @@ Multiple GPTQ parameter permutations are provided; see Provided Files below for
42
  ## Prompt template: Llama-2-Chat
43
 
44
  ```
45
- SYSTEM: You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
46
- USER: {prompt}
47
- ASSISTANT:
 
48
  ```
49
 
50
  ## Provided files
@@ -132,10 +133,10 @@ model = AutoGPTQForCausalLM.from_quantized(model_name_or_path,
132
  """
133
 
134
  prompt = "Tell me about AI"
135
- prompt_template=f'''SYSTEM: You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
136
- USER: {prompt}
137
- ASSISTANT:
138
- '''
139
 
140
  print("\n\n*** Generate:")
141
 
 
42
  ## Prompt template: Llama-2-Chat
43
 
44
  ```
45
+ [INST] <<SYS>>
46
+ You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
47
+ <</SYS>>
48
+ {prompt}[/INST]
49
  ```
50
 
51
  ## Provided files
 
133
  """
134
 
135
  prompt = "Tell me about AI"
136
+ prompt_template=f'''[INST] <<SYS>>
137
+ You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
138
+ <</SYS>>
139
+ {prompt}[/INST]'''
140
 
141
  print("\n\n*** Generate:")
142