DarkForest-20B-v1.0-bpw8.0-h8-exl2 / mergekit-config_step1.yml
TeeZee's picture
Upload mergekit-config_step1.yml with huggingface_hub
a9d6998 verified
raw
history blame contribute delete
377 Bytes
slices:
- sources:
- model: ../KoboldAI_LLaMA2-13B-Erebus-v3
layer_range: [0, 16]
- sources:
- model: ../microsoft_Orca-2-13b
layer_range: [8, 24]
- sources:
- model: ../KoboldAI_LLaMA2-13B-Erebus-v3
layer_range: [17, 32]
- sources:
- model: ../microsoft_Orca-2-13b
layer_range: [25, 40]
merge_method: passthrough
dtype: float16