reeducator
commited on
Commit
•
9b4cebd
1
Parent(s):
ebd202f
Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,25 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
datasets:
|
3 |
+
- gozfarb/bluemoon_roleplay_300k_vicuna
|
4 |
+
language:
|
5 |
+
- en
|
6 |
+
---
|
7 |
+
## General
|
8 |
+
Bluemoon roleplay finetune of LLaMA 13B (2 roleplayers only).
|
9 |
+
|
10 |
+
*Note.* This is an intermediate version which has not been trained for sufficiently long to reach a satisfactory final loss value. The repository will be updated later with a model trained over additional epochs.
|
11 |
+
|
12 |
+
## Models
|
13 |
+
*GGML 4-bit for llama.cpp*<br/>
|
14 |
+
ggml-bluemoonrp-13b-epoch3-q5_0.bin
|
15 |
+
|
16 |
+
*GPTQ 4-bit CUDA:*<br/>
|
17 |
+
bluemoonrp-13b-epoch3-4bit-128g.safetensors<br/>
|
18 |
+
|
19 |
+
## Remarks
|
20 |
+
This model has been trained using the following prompt (Vicuna 1.1 format):
|
21 |
+
```
|
22 |
+
A transcript of a roleplay between two players, LEAD and ASSOCIATE. LEAD sets up a scenario and the characters, from which ASSOCIATE then assumes a character role and continues the story for that role in response to description given by LEAD. The story and characters are developed by exchange of detailed event descriptions and character dialogs, successively given by both LEAD and ASSOCIATE.
|
23 |
+
LEAD: [role1 message]
|
24 |
+
ASSOCIATE: [role2 message]</s>
|
25 |
+
```
|