README.md

metadata

base_model:
  - SanjiWatsuki/Silicon-Maid-7B
  - sethuiyer/Aika-7B
  - sethuiyer/Nandine-7b
  - mlabonne/AlphaMonarch-7B
library_name: transformers
tags:
  - mergekit
  - merge

Diana-7B

Diana-7B is a versatile AI language model designed to provide a wide range of capabilities, including conversational skills, problem-solving, information retrieval, creative writing, and logical reasoning. It is a merge of the following models using mergekit:

1. mlabonne/AlphaMonarch-7B: This model has impressive conversational abilities, formal and sophisticated style, and strong reasoning skills.
2. sethuiyer/Aika-7b: A merge of SanjiWatsuki/Silicon-Maid-7B, Guilherme34/Samantha-v2, jan-hq/stealth-v1.3, and senseable/WestLake-7B-v2, Aika-7b is designed for natural and human-like interactions, accurate information delivery, comprehensive analysis, emotional intelligence, clarity, and structure.
3. SanjiWatsuki/Silicon-Maid-7B: This model is known for its excellent multi-turn conversational skills and logical coherence.
4. sethuiyer/Nandine-7b: A merge of senseable/Westlake-7B, Guilherme34/Samantha-v2, and uukuguy/speechless-mistral-six-in-one-7b, Nandine-7b excels in narrative skill, empathetic interaction, intellectual depth, and eloquent communication.

By combining these models, Diana-7B offers a balanced blend of capabilities, making it suitable for various tasks and providing a comprehensive AI companion for creative writing, thoughtful discussions, problem-solving, and general assistance. However, it is essential to note that each model has its strengths and weaknesses, as outlined in the descriptions above.

Configuration

The following YAML configuration was used to produce this model:

base_model: mlabonne/AlphaMonarch-7B
dtype: bfloat16
merge_method: dare_ties
models:
- model: mlabonne/AlphaMonarch-7B
- model: sethuiyer/Aika-7B
  parameters:
    density: 0.85
    weight: 0.30
- model: SanjiWatsuki/Silicon-Maid-7B
  parameters:
    density: 0.85
    weight: 0.50
- model: sethuiyer/Nandine-7b
  parameters:
    density: 0.85
    weight: 0.30
parameters:
  int8_mask: true