saishf commited on
Commit
c9f9ed5
1 Parent(s): 0ee6ba5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -2
README.md CHANGED
@@ -5,16 +5,23 @@ base_model:
5
  - OpenPipe/mistral-ft-optimized-1227
6
  - ChaoticNeutrals/Eris_7B
7
  library_name: transformers
 
8
  tags:
9
  - mergekit
10
  - merge
11
-
 
 
12
  ---
13
  # merge
14
 
15
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
16
 
17
  ## Merge Details
 
 
 
 
18
  ### Merge Method
19
 
20
  This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [OpenPipe/mistral-ft-optimized-1227](https://huggingface.co/OpenPipe/mistral-ft-optimized-1227) as a base.
@@ -52,4 +59,4 @@ parameters:
52
  int8_mask: true
53
  dtype: bfloat16
54
 
55
- ```
 
5
  - OpenPipe/mistral-ft-optimized-1227
6
  - ChaoticNeutrals/Eris_7B
7
  library_name: transformers
8
+ license: cc-by-nc-4.0
9
  tags:
10
  - mergekit
11
  - merge
12
+ language:
13
+ - en
14
+ pipeline_tag: text-generation
15
  ---
16
  # merge
17
 
18
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
19
 
20
  ## Merge Details
21
+ * This model is an attempt at making a smart rp model with the finesse of [Epiculous/Fett-uccine-7B](https://huggingface.co/Epiculous/Fett-uccine-7B).
22
+ * From limited testing i've found it to be my favourite of my personal 7B models. It stays pretty coherent at 8k+ ctx.
23
+ * I like to use "Alpaca" format with "Universal-Light" for longer messages. Switching to ChatML causes the messages to be much shorter? I haven't a clue why but sometimes it's nice.
24
+ * It doesn't seem to show many issues but i'd be willing to try to fix any problems or bugs as it shows some potential.
25
  ### Merge Method
26
 
27
  This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [OpenPipe/mistral-ft-optimized-1227](https://huggingface.co/OpenPipe/mistral-ft-optimized-1227) as a base.
 
59
  int8_mask: true
60
  dtype: bfloat16
61
 
62
+ ```