MrRobotoAI/Hathor-v3.1

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the linear DARE merge method using MrRobotoAI/Hathor-v4.1 as a base.

Models Merged

The following models were included in the merge:

• OmnicromsBrain/Eros_Scribe-7b
• MrRobotoAI/Test001a.2
• FPHam/Karen_TheEditor_V2_CREATIVE_Mistral_7B
• OmnicromsBrain/StoryFusion-7B
• MrRobotoAI/Test002a.2
• OmnicromsBrain/EverythingBagel-DPO-7B
• OmnicromsBrain/NeuralStar_Fusion-7B
• FPHam/Autolycus-Mistral_7B
• OmnicromsBrain/ToppyCox-7B
• FPHam/Writing_Partner_Mistral_7B
• Aratako/Antler-7B-Novel-Writing
• Aratako/SniffyOtter-7B-Novel-Writing-NSFW
• MrRobotoAI/Hathor

Configuration

The following YAML configuration was used to produce this model:

 ### This the config.yml for ABC_Books/test003 ###
 models:

  - model: OmnicromsBrain/Eros_Scribe-7b
    parameters:
      weight: 0.1111
      density: 0.9
  - model: OmnicromsBrain/EverythingBagel-DPO-7B
    parameters:
      weight: 0.0556
      density: 0.9
  - model: OmnicromsBrain/NeuralStar_Fusion-7B
    parameters:
      weight: 0.0556
      density: 0.9
  - model: OmnicromsBrain/StoryFusion-7B
    parameters:
      weight: 0.0556
      density: 0.9
  - model: OmnicromsBrain/ToppyCox-7B
    parameters:
      weight: 0.0556
      density: 0.9
  - model: Aratako/Antler-7B-Novel-Writing
    parameters:
      weight: 0.1111
      density: 0.9
  - model: Aratako/SniffyOtter-7B-Novel-Writing-NSFW
    parameters:
      weight: 0.1111
      density: 0.9
  - model: FPHam/Autolycus-Mistral_7B
    parameters:
      weight: 0.0556
      density: 0.9
  - model: FPHam/Karen_TheEditor_V2_CREATIVE_Mistral_7B
    parameters:
      weight: 0.0556
      density: 0.9
  - model: FPHam/Writing_Partner_Mistral_7B
    parameters:
      weight: 0.0556
      density: 0.9
 ### Here they add in a previously worked model that understands writing styles, literature, poetry, psychology, and philosophy, but still retain    some bias and is censored. They also add in the two previous merges to the final merge as well. ### 
  - model: MrRobotoAI/Hathor
    parameters:
      weight: 0.1111
      density: 0.9
  ### Notice that the last merge will only constitute a small portion of the final model ###
  - model: MrRobotoAI/Test002a.2
    parameters:
      weight: 0.0556
      density: 0.9
  - model: MrRobotoAI/Test001a.2
    parameters:
      weight: 0.1111
      density: 0.9

 merge_method: dare_linear
 base_model: MrRobotoAI/Hathor-v4.1
 parameters:
  normalize: true
 dtype: float16