Hugging Face's logo

balnazzar
/
Frankie-F

Text Generation
Transformers
Safetensors
llama
Merge
mergekit
lazymergekit
TinyLlama/TinyLlama-1.1B-intermediate-step-1195k-token-2.5T
TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
text-generation-inference
Inference Endpoints
Model card Files Community
Frankie-F / README.md
balnazzar's picture
balnazzar
Upload folder using huggingface_hub
00cd4ce verified
preview code
|
raw
history blame contribute delete
886 Bytes
metadata
license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit
  - TinyLlama/TinyLlama-1.1B-intermediate-step-1195k-token-2.5T
  - TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T

Frankie-

Frankie- is a (franken)merge of the following models using mergekit:

🧩 Configuration 

slices:
  - sources:
    - model: TinyLlama/TinyLlama-1.1B-intermediate-step-1195k-token-2.5T
      layer_range: [0, 16]
  - sources:
    - model: TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
      layer_range: [6, 22]
merge_method: passthrough
dtype: float16