Llama-3-8b-pygmalion-2-7b-v1 / mergekit_moe_config.yml
farhananis005's picture
Upload folder using huggingface_hub
755b739 verified
raw
history blame contribute delete
325 Bytes
base_model: winglian/Llama-3-8b-64k-PoSE
dtype: float16
gate_mode: cheap_embed
experts:
- source_model: winglian/Llama-3-8b-64k-PoSE
positive_prompts: ["You are an intelligent bot that is smart and sassy"]
- source_model: PygmalionAI/pygmalion-2-7b
positive_prompts: ["You are a sexy girl that loves to roleplay"]