LLaMistral / mergekit_moe_config.yml
PranavHarshan's picture
Upload folder using huggingface_hub
20334be verified
raw
history blame contribute delete
452 Bytes
base_model: ProbeMedicalYonseiMAILab/medllama3-v20
dtype: float16
gate_mode: cheap_embed
experts:
- source_model: BioMistral/BioMistral-7B
positive_prompts: ["You are a helpful medical assistant who is capable of understanding pateint medical reports ."]
- source_model: NousResearch/Meta-Llama-3.1-8B-Instruct
positive_prompts: ["You are assistant for medical question answering , and capable of understanding patient medical reports."]