Edit model card

image/png

Jeitral: "Eris, the Greek goddess of chaos and discord."

Notes: Model should be excellent for both RP/Chat related tasks. Seems to be working in both Alpaca/Chatml.

Collaborative effort from both @Jeiku and @Nitral involving what we currently felt were our best individual projects.

We hope you enjoy! - The Chaotic Neutrals.

Imatrix GGUF Quants Thanks to @Lewdiculus: https://huggingface.co/Lewdiculous/Eris_7B-GGUF-IQ-Imatrix

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

slices:
  - sources:
      - model: Test157t/Prima-LelantaclesV6-7b
        layer_range: [0, 32]
      - model: ChaoticNeutrals/Prodigy_7B
        layer_range: [0, 32]
merge_method: slerp
base_model: Test157t/Prima-LelantaclesV6-7b
parameters:
  t:
    - filter: self_attn
      value: [0, 0.5, 0.3, 0.7, 1]
    - filter: mlp
      value: [1, 0.5, 0.7, 0.3, 0]
    - value: 0.5
dtype: bfloat16

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 73.68
AI2 Reasoning Challenge (25-Shot) 71.42
HellaSwag (10-Shot) 87.99
MMLU (5-Shot) 65.24
TruthfulQA (0-shot) 66.95
Winogrande (5-shot) 84.21
GSM8k (5-shot) 66.26
Downloads last month
74
Safetensors
Model size
7.24B params
Tensor type
BF16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for ChaoticNeutrals/Eris_7B

Evaluation results