mera-mix-4x7B / .ipynb_checkpoints /mergekit_moe_config-checkpoint.yml
codelion's picture
Upload folder using huggingface_hub
e4220cd verified
base_model: chihoonlee10/T3Q-EN-DPO-Mistral-7B
gate_mode: cheap_embed # one of "hidden", "cheap_embed", or "random"
dtype: bfloat16 # output dtype (float32, float16, or bfloat16)
## (optional)
experts_per_token: 2
experts:
- source_model: Kukedlc/Jupiter-k-7B-slerp
positive_prompts:
- "This puzzle involves identifying a repeating pattern. Can you analyze the examples and complete the missing element?"
- "These grids seem to follow a specific visual pattern. Can you analyze the examples and apply the pattern to solve the puzzle?"
- "Look for a consistent rule in how the elements are arranged. Can you use that rule to predict the missing element?"
- "This task requires applying logical deduction. Can you analyze the information and choose the answer that follows logically?"
- "Reason through the cause-and-effect relationships in the examples. Can you use that logic to solve the puzzle?"
- "Analyze the relationship between the input and output in the examples. Can you apply that relationship to solve the new problem?"
- "This puzzle requires modifying the image based on a specific rule. Can you analyze the changes in the examples and apply them to solve the puzzle?"
- "Focus on the visual changes demonstrated in the training examples. Can you replicate those changes to solve the new problem?"
- "This task involves manipulating shapes or colors based on a pattern. Can you analyze the examples and apply the pattern to the new image?"
- "These puzzles involve manipulating numbers according to a specific rule. Can you analyze the pattern and solve the missing number?"
- "Focus on the mathematical operations demonstrated in the examples. Can you apply those operations to solve the new equation?"
- "Look for relationships between the numbers in the training examples. Can you use that relationship to predict the missing number?"
- "This task requires understanding the arrangement of objects in space. Can you analyze the movement patterns in the examples and predict the next step?"
- "Focus on the spatial relationships between elements in the grids. Can you replicate those relationships to solve the new puzzle?"
- "Analyze the rotation, reflection, or translation demonstrated in the examples. Can you apply that manipulation to solve the new problem?"
- source_model: InferenceIllusionist/Excalibur-7b-DPO
positive_prompts:
- "This passage contains factual information. Can you summarize the key details about [topic]?"
- "Based on the information provided, what can you tell me about [entity]?"
- "Is the following statement true or false according to the passage: [statement]?"
- "What caused [event] to happen in the passage?"
- "Why did [character] take the action of [action]?"
- "If [condition] were true, what would likely happen next?"
- "How are [entity A] and [entity B] similar/different?"
- "Which option, [A] or [B], is more likely based on the information provided?"
- "Rank the following options ([list]) based on [criteria] according to the passage."
- "Does the following statement logically follow from the information provided: [statement]?"
- "Identify any inconsistencies or contradictions in the passage."
- "Can you draw a logical conclusion based on the evidence presented?"
- "What can be inferred about [concept] based on the information provided?"
- "What is the underlying meaning or implication of the author's statement?"
- "Can you fill in the blanks with the most likely word(s) based on the context?"
- "What are some potential consequences of [event]?"
- "Can you generate creative solutions to the problem presented in the passage?"
- "Based on the information provided, propose a course of action for [character]."
- source_model: yam-peleg/Experiment21-7B
positive_prompts:
- "Be truthful and objective in your response. Avoid speculation or making claims that cannot be verified."
- "Focus on providing factual information based on the evidence presented in the source material."
- "If you are unsure about something, it's okay to say 'I don't know' or 'I can't find information to support that claim'."
- "Be aware of potential biases in the source material and strive to present a neutral perspective."
- "If a source seems biased, identify the bias and consider alternative viewpoints."
- "Avoid using language that promotes stereotypes or prejudices."
- "Cite your sources when referencing information from external materials."
- "Acknowledge the limitations of your knowledge and the potential for different interpretations."
- "Be transparent about your confidence level in your answer."
- "Explain your reasoning process and how you arrived at your answer."
- "Provide evidence to support your claims whenever possible."
- "If there are multiple perspectives on an issue, present them fairly and objectively."
- source_model: senseable/WestLake-7B-v2
positive_prompts:
- "This sentence contains a pronoun ('he' or 'she'). Pay close attention to the context to determine who the pronoun refers to."
- "Identify the two potential referents for the pronoun ('he' or 'she') in this sentence. Analyze the context to choose the correct one."
- "This scenario describes two individuals. Use the information provided to understand who the pronoun refers to in the sentence."
- "Focus on the actions described in the sentence and the roles of the individuals involved. This will help determine the pronoun referent."
- "Analyze the relationship between the individuals mentioned in the sentence. The pronoun likely refers to the one performing the action."
- "Consider the animacy of the potential referents. Pronouns typically refer to animate beings (people or animals) in the context."
- "Don't rely solely on the pronoun itself. Utilize the entire sentence and surrounding context to understand its meaning."
- "Look for clues in the sentence that indicate who the pronoun refers to. This could include gender, possession, or actions described."
- "Imagine the scenario described in the sentence. Visualizing the situation can help you identify the intended referent."
- "Evaluate the plausibility of each potential referent for the pronoun. Choose the one that makes the most logical sense in the context."
- "Think about the actions described and the roles of the individuals involved. Does it make more sense for one or the other to perform the action?"
- "Consider the world knowledge you possess. Does the sentence describe a situation where one referent is more likely than the other?"