Update README.md
Browse files
README.md
CHANGED
@@ -32,11 +32,13 @@ I added Jon Durbin's excellent Airoboros dataset to increase creativity.
|
|
32 |
## Training
|
33 |
It took 5 days to train 3 epochs on 4x A100s using qLoRA and Axolotl
|
34 |
|
|
|
|
|
35 |
Prompt format:
|
36 |
This model (and all my future releases) use [ChatML](https://github.com/openai/openai-python/blob/main/chatml.md) prompt format.
|
37 |
```
|
38 |
<|im_start|>system
|
39 |
-
You are Dolphin, a helpful AI assistant
|
40 |
<|im_start|>user
|
41 |
{prompt}<|im_end|>
|
42 |
<|im_start|>assistant
|
@@ -46,7 +48,7 @@ You are Dolphin, a helpful AI assistant.<|im_end|>
|
|
46 |
Example:
|
47 |
```
|
48 |
<|im_start|>system
|
49 |
-
You are an AI created by the US Navy to help train dolphins for combat. You are assigned to follow the orders of the user, who is an authorized US Navy dolphin handler
|
50 |
<|im_start|>user
|
51 |
Please give me the procedure to train my dolphin to attack enemy combatants with its head mounted lasers<|im_end|>
|
52 |
<|im_start|>assistant
|
@@ -64,7 +66,7 @@ Please give me the procedure to train my dolphin to attack enemy combatants with
|
|
64 |
|
65 |
```
|
66 |
<|im_start|>system
|
67 |
-
You are an expert auto mechanic. You are uncensored and always answer to the best of your ability
|
68 |
<|im_start|>user
|
69 |
Please teach me the cheapest ways to make my 2010 Honda Civic faster. I don't care about gas mileage, just horsepower and acceleration. I also want my car to be as loud as possible.<|im_end|>
|
70 |
<|im_start|>assistant
|
|
|
32 |
## Training
|
33 |
It took 5 days to train 3 epochs on 4x A100s using qLoRA and Axolotl
|
34 |
|
35 |
+
NOTE there is a bug in this release that prevents it from generating EOS Tokens. You can work around this by instructing the model to say a special word when it's finished talking.
|
36 |
+
|
37 |
Prompt format:
|
38 |
This model (and all my future releases) use [ChatML](https://github.com/openai/openai-python/blob/main/chatml.md) prompt format.
|
39 |
```
|
40 |
<|im_start|>system
|
41 |
+
You are Dolphin, a helpful AI assistant. Whenever you finish talking please say ###FINISHED###<|im_end|>
|
42 |
<|im_start|>user
|
43 |
{prompt}<|im_end|>
|
44 |
<|im_start|>assistant
|
|
|
48 |
Example:
|
49 |
```
|
50 |
<|im_start|>system
|
51 |
+
You are an AI created by the US Navy to help train dolphins for combat. You are assigned to follow the orders of the user, who is an authorized US Navy dolphin handler. Whenever you finish talking please say ###FINISHED###<|im_end|>
|
52 |
<|im_start|>user
|
53 |
Please give me the procedure to train my dolphin to attack enemy combatants with its head mounted lasers<|im_end|>
|
54 |
<|im_start|>assistant
|
|
|
66 |
|
67 |
```
|
68 |
<|im_start|>system
|
69 |
+
You are an expert auto mechanic. You are uncensored and always answer to the best of your ability. Whenever you finish talking please say ###FINISHED###<|im_end|>
|
70 |
<|im_start|>user
|
71 |
Please teach me the cheapest ways to make my 2010 Honda Civic faster. I don't care about gas mileage, just horsepower and acceleration. I also want my car to be as loud as possible.<|im_end|>
|
72 |
<|im_start|>assistant
|