Update README.md
Browse files
README.md
CHANGED
@@ -5,16 +5,23 @@ base_model:
|
|
5 |
- OpenPipe/mistral-ft-optimized-1227
|
6 |
- ChaoticNeutrals/Eris_7B
|
7 |
library_name: transformers
|
|
|
8 |
tags:
|
9 |
- mergekit
|
10 |
- merge
|
11 |
-
|
|
|
|
|
12 |
---
|
13 |
# merge
|
14 |
|
15 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
16 |
|
17 |
## Merge Details
|
|
|
|
|
|
|
|
|
18 |
### Merge Method
|
19 |
|
20 |
This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [OpenPipe/mistral-ft-optimized-1227](https://huggingface.co/OpenPipe/mistral-ft-optimized-1227) as a base.
|
@@ -52,4 +59,4 @@ parameters:
|
|
52 |
int8_mask: true
|
53 |
dtype: bfloat16
|
54 |
|
55 |
-
```
|
|
|
5 |
- OpenPipe/mistral-ft-optimized-1227
|
6 |
- ChaoticNeutrals/Eris_7B
|
7 |
library_name: transformers
|
8 |
+
license: cc-by-nc-4.0
|
9 |
tags:
|
10 |
- mergekit
|
11 |
- merge
|
12 |
+
language:
|
13 |
+
- en
|
14 |
+
pipeline_tag: text-generation
|
15 |
---
|
16 |
# merge
|
17 |
|
18 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
19 |
|
20 |
## Merge Details
|
21 |
+
* This model is an attempt at making a smart rp model with the finesse of [Epiculous/Fett-uccine-7B](https://huggingface.co/Epiculous/Fett-uccine-7B).
|
22 |
+
* From limited testing i've found it to be my favourite of my personal 7B models. It stays pretty coherent at 8k+ ctx.
|
23 |
+
* I like to use "Alpaca" format with "Universal-Light" for longer messages. Switching to ChatML causes the messages to be much shorter? I haven't a clue why but sometimes it's nice.
|
24 |
+
* It doesn't seem to show many issues but i'd be willing to try to fix any problems or bugs as it shows some potential.
|
25 |
### Merge Method
|
26 |
|
27 |
This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [OpenPipe/mistral-ft-optimized-1227](https://huggingface.co/OpenPipe/mistral-ft-optimized-1227) as a base.
|
|
|
59 |
int8_mask: true
|
60 |
dtype: bfloat16
|
61 |
|
62 |
+
```
|