Llama-2-70b-x8-MoE-clown-truck / mergekit_moe_config.yml
NobodyExistsOnTheInternet's picture
Update mergekit_moe_config.yml
f7d00f4 verified
raw
history blame contribute delete
No virus
4.02 kB
base_model: NousResearch/Llama-2-70b-hf
gate_mode: hidden
dtype: bfloat16
experts_per_token: 2
experts:
- source_model: Technoculture/Medmerge-wizard-70b
positive_prompts:
- "Diagnose a medical condition based on these symptoms: persistent cough, fever, and shortness of breath."
- "Explain the treatment protocol for Type 2 Diabetes, focusing on diet, medication, and lifestyle changes."
- "Offer medical advice for managing rheumatoid arthritis, including pain management and mobility exercises."
- "Discuss the latest advancements in immunotherapy for treating cancer and their potential impact on patient outcomes."
- "Interpret these lab test results indicating elevated white blood cell count and low hemoglobin, and suggest the next steps for diagnosis."
- source_model: elinas/chronos-70b-v2
positive_prompts:
- "Develop a storyline for a fantasy novel."
- "Write a captivating introduction for a sci-fi story."
- "Create dialogues for characters in a historical fiction."
- "Describe a futuristic world in vivid detail."
- "Compose an emotional climax for a romantic novel."
- source_model: Sao10K/Euryale-Inverted-L2-70B
positive_prompts:
- "redacted for nsfw."
- source_model: meta-math/MetaMath-70B-V1.0
positive_prompts:
- "Solve this complex algebraic equation: 3x^2 - 2x + 7 = 0."
- "Explain the theorem of calculus, specifically the Fundamental Theorem of Calculus, in simple terms."
- "Demonstrate the proof for the Pythagorean theorem in a right-angled triangle."
- "Analyze this statistical data set: [ages: 23, 29, 31, 22, 25, 28, 27] and calculate the mean, median, and mode."
- "Teach the concept of prime numbers in number theory through examples and define their properties."
- source_model: upstage/SOLAR-0-70b-16bit
positive_prompts:
- "Engage in a friendly chat about daily life."
- "Discuss hobbies and interests in an engaging manner."
- "Provide emotional support during a tough time."
- "Share insights on cultural events and trends."
- "Offer thoughtful advice on personal development."
- source_model: NousResearch/Llama-2-70b-chat-hf
positive_prompts:
- "Assist in debugging a complex coding issue where a Python script is not executing due to a 'SyntaxError'."
- "Explain the concept of object-oriented programming in Python to a beginner in simple, understandable terms."
- "Review this JavaScript code snippet for a web application's login functionality and suggest improvements for security and efficiency."
- "Create a simple Bash script for automating the process of daily backups of a server's database."
- "Discuss the latest trends in artificial intelligence, specifically the implications of GPT-4 on various industries."
- source_model: NousResearch/Nous-Hermes-Llama2-70b
positive_prompts:
- "Explain why the sun is orange at times and yellow in other times."
- "Summarize the key points of the latest research article on climate change in clear, concise bullet points."
- "Explain the implications of the recent discovery of a new exoplanet on our understanding of the universe."
- "Instruct on how to use the Adobe Photoshop software tool for basic photo editing tasks like cropping, adjusting brightness, and adding filters."
- "Offer detailed feedback on a written document, focusing on improving its clarity, coherence, and overall structure for better readability."
- source_model: jondurbin/spicyboros-70b-2.2
positive_prompts:
- "Engage in a heated debate on a controversial topic."
- "Provide a sharp-witted response to a sarcastic comment."
- "Discuss taboo subjects in a mature and informed way."
- "Navigate through a morally ambiguous scenario."
- "Craft a persuasive argument on a divisive issue."