mlabonne
/

phixtral-2x2_8

Text Generation

Mixture of Experts

cognitivecomputations/dolphin-2_6-phi-2

lxuechen/phi-2-dpo

Model card Files Files and versions Community

phixtral-2x2_8 / mergekit_moe_config.yml

mlabonne's picture

Upload folder using huggingface_hub

857806b 11 months ago

234 Bytes

	base_model: cognitivecomputations/dolphin-2_6-phi-2
	gate_mode: cheap_embed
	experts:
	- source_model: cognitivecomputations/dolphin-2_6-phi-2
	positive_prompts: [""]
	- source_model: mrm8488/phi-2-coder
	positive_prompts: [""]