andreaskoepf commited on
Commit
04231ec
1 Parent(s): 27a2ef3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -1
README.md CHANGED
@@ -4,4 +4,21 @@ license: llama2
4
  - 650 steps, BS 64
5
  - [wandb run](https://wandb.ai/open-assistant/epfl-mt-sft/runs/run16)
6
  - [sampling-report](https://open-assistant.github.io/oasst-model-eval/?f=https%3A%2F%2Fraw.githubusercontent.com%2FOpen-Assistant%2Foasst-model-eval%2Fmain%2Fsampling_reports%2Foasst-sft%2F2023-08-11_andreaskoepf_llama2-7b-oasst-baseline_sampling_noprefix2.json)
7
- -
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4
  - 650 steps, BS 64
5
  - [wandb run](https://wandb.ai/open-assistant/epfl-mt-sft/runs/run16)
6
  - [sampling-report](https://open-assistant.github.io/oasst-model-eval/?f=https%3A%2F%2Fraw.githubusercontent.com%2FOpen-Assistant%2Foasst-model-eval%2Fmain%2Fsampling_reports%2Foasst-sft%2F2023-08-11_andreaskoepf_llama2-7b-oasst-baseline_sampling_noprefix2.json)
7
+
8
+ ### Prompt template
9
+
10
+ [chatml](https://github.com/openai/openai-python/blob/main/chatml.md) format is used:
11
+ "<|im_start|>system\n{system message}<|im_end|>\n<|im_start|>user\n{user prompt}<|im_end|>\n<|im_start|>assistant\n{Assistant answer}<|im_end|>\n"
12
+
13
+ multi-line:
14
+
15
+ ```
16
+ """
17
+ <|im_start|>system
18
+ {system message}<|im_end|>
19
+ <|im_start|>user
20
+ {user prompt}<|im_end|>
21
+ <|im_start|>assistant
22
+ {Assistant answer}<|im_end|>
23
+ """
24
+ ```