andreaskoepf
commited on
Commit
•
04231ec
1
Parent(s):
27a2ef3
Update README.md
Browse files
README.md
CHANGED
@@ -4,4 +4,21 @@ license: llama2
|
|
4 |
- 650 steps, BS 64
|
5 |
- [wandb run](https://wandb.ai/open-assistant/epfl-mt-sft/runs/run16)
|
6 |
- [sampling-report](https://open-assistant.github.io/oasst-model-eval/?f=https%3A%2F%2Fraw.githubusercontent.com%2FOpen-Assistant%2Foasst-model-eval%2Fmain%2Fsampling_reports%2Foasst-sft%2F2023-08-11_andreaskoepf_llama2-7b-oasst-baseline_sampling_noprefix2.json)
|
7 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
4 |
- 650 steps, BS 64
|
5 |
- [wandb run](https://wandb.ai/open-assistant/epfl-mt-sft/runs/run16)
|
6 |
- [sampling-report](https://open-assistant.github.io/oasst-model-eval/?f=https%3A%2F%2Fraw.githubusercontent.com%2FOpen-Assistant%2Foasst-model-eval%2Fmain%2Fsampling_reports%2Foasst-sft%2F2023-08-11_andreaskoepf_llama2-7b-oasst-baseline_sampling_noprefix2.json)
|
7 |
+
|
8 |
+
### Prompt template
|
9 |
+
|
10 |
+
[chatml](https://github.com/openai/openai-python/blob/main/chatml.md) format is used:
|
11 |
+
"<|im_start|>system\n{system message}<|im_end|>\n<|im_start|>user\n{user prompt}<|im_end|>\n<|im_start|>assistant\n{Assistant answer}<|im_end|>\n"
|
12 |
+
|
13 |
+
multi-line:
|
14 |
+
|
15 |
+
```
|
16 |
+
"""
|
17 |
+
<|im_start|>system
|
18 |
+
{system message}<|im_end|>
|
19 |
+
<|im_start|>user
|
20 |
+
{user prompt}<|im_end|>
|
21 |
+
<|im_start|>assistant
|
22 |
+
{Assistant answer}<|im_end|>
|
23 |
+
"""
|
24 |
+
```
|