TeeZee
/

2xbagel-34b-v0.2-bpw3.0-h6-exl2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

2xbagel-34b-v0.2-bpw3.0-h6-exl2 / mergekit_config.yml

TeeZee's picture

Upload mergekit_config.yml with huggingface_hub

d4ad443 verified 3 months ago

152 Bytes

	dtype: bfloat16
	merge_method: passthrough
	slices:
	- sources:
	- layer_range: [0, 100]
	model: ./2x_bagel-34b-v0.2_ultra_fp32
	name: bagel_new