Any positive/negative prompts for merging?
#2
by
adi-kmt
- opened
Looked at https://huggingface.co/mlabonne/phixtral-4x2_8/discussions/6 and wanted to know if you added any pos/neg prompts?
I used positive prompts but no negative prompts. Doesn’t actually change the output with a random gate whatsoever until it’s trained, but can help the gate later on apparently. I’ll post the mergekit config
Added the yaml in Training-Configs folder. Closing thread!
Crystalcareai
changed discussion status to
closed
Thanks a lot!!