Undi95/Utopia-13B-GGUF

Description

This repo contains quantized files of Utopia-13B, a merge I have done with the new task_arithmetic merge method from mergekit.

Models and loras used

• Xwin-LM/Xwin-LM-13B-V0.2
• NeverSleep/Nethena-13B
• PygmalionAI/pygmalion-2-13b
• Undi95/Storytelling-v2.1-13B-lora
• zattio770/120-Days-of-LORA-v2-13B
• lemonilia/LimaRP-Llama2-13B-v3-EXPERIMENT

The sauce

Xwin-LM/Xwin-LM-13B-V0.2
Undi95/Storytelling-v2.1-13B-lora
=> p1

NeverSleep/Nethena-13B
zattio770/120-Days-of-LORA-v2-13B
=> p2

PygmalionAI/pygmalion-2-13b
lemonilia/LimaRP-Llama2-13B-v3-EXPERIMENT
=> p3



merge_method: task_arithmetic
base_model: TheBloke/Llama-2-13B-fp16
models:
  - model: TheBloke/Llama-2-13B-fp16
  - model: Undi95/newpart1
    parameters:
      weight: 1.0
  - model: Undi95/newpart2
    parameters:
      weight: 0.45
  - model: Undi95/newpart3
    parameters:
      weight: 0.33
dtype: float16

Prompt template: Alpaca

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:

If you want to support me, you can here.