BeagleCatMunin-GGUF / README.md
timpal0l's picture
Update README.md
6f66d6c verified
metadata
language:
  - sv
  - da
  - 'no'
  - is
  - en
license: apache-2.0
tags:
  - merge
base_model:
  - timpal0l/Mistral-7B-v0.1-flashback-v2
  - RJuro/munin-neuralbeagle-7b-GGUF
pipeline_tag: text-generation

How to use (16bit):

ollama run timpal0l/beaglecatmunin "Hejsan!"

This model is a merge of timpal0l/Mistral-7B-v0.1-flashback-v2 and RJuro/munin-neuralbeagle-7b.

config.yaml

models:
  - model: timpal0l/Mistral-7B-v0.1-flashback-v2
    # No parameters necessary for base model
  - model: RJuro/munin-neuralbeagle-7b
    parameters:
      density: 0.53
      weight: 0.6
merge_method: dare_ties
base_model: timpal0l/Mistral-7B-v0.1-flashback-v2
parameters:
  int8_mask: true
dtype: bfloat16