2xbagel-34b-v0.2-bpw3.0-h6-exl2 / mergekit_config.yml
TeeZee's picture
Upload mergekit_config.yml with huggingface_hub
d4ad443 verified
raw
history blame contribute delete
152 Bytes
dtype: bfloat16
merge_method: passthrough
slices:
- sources:
- layer_range: [0, 100]
model: ./2x_bagel-34b-v0.2_ultra_fp32
name: bagel_new