MistralMoE / mergekit_moe_config.yml
femiari's picture
Upload folder using huggingface_hub
cf414ca verified
raw
history blame contribute delete
No virus
392 Bytes
base_model: NousResearch/Nous-Hermes-2-Mistral-7B-DPO
experts:
- source_model: NousResearch/Nous-Hermes-2-Mistral-7B-DPO
positive_prompts:
- "chat"
- "assistant"
- "tell me"
- "explain"
- "I want"
- source_model: yam-peleg/Hebrew-Mistral-7B
positive_prompts:
- "code"
- "python"
- "javascript"
- "programming"
- "algorithm"
- "hebrew"