Frankie-tiny / README.md
balnazzar's picture
Upload folder using huggingface_hub
26ffb4b verified
metadata
license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit
  - Locutusque/TinyMistral-248M-v2-Instruct
  - Locutusque/TinyMistral-248M-v2-Instruct

Frankie-tiny

Frankie-tiny is a (franken)merge of the following models using mergekit:

🧩 Configuration

slices:
  - sources:
    - model: Locutusque/TinyMistral-248M-v2-Instruct
      layer_range: [0, 12]
  - sources:
    - model: Locutusque/TinyMistral-248M-v2-Instruct
      layer_range: [8, 12]
merge_method: passthrough
dtype: float16