--- base_model: - MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy - ResplendentAI/Aura_Llama3 - MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy - ResplendentAI/Theory_of_Mind_Llama3 - MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy - ResplendentAI/Luna_Llama3 - MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy - ResplendentAI/BlueMoon_Llama3 - MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy - ResplendentAI/NoWarning_Llama3 - MrRobotoAI/llama3-8B-Special-Dark-v2.0 - MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy - Blackroot/Llama-3-LongStory-LORA library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [MrRobotoAI/llama3-8B-Special-Dark-v2.0](https://huggingface.co/MrRobotoAI/llama3-8B-Special-Dark-v2.0) as a base. ### Models Merged The following models were included in the merge: * [MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy](https://huggingface.co/MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy) + [ResplendentAI/Aura_Llama3](https://huggingface.co/ResplendentAI/Aura_Llama3) * [MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy](https://huggingface.co/MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy) + [ResplendentAI/Theory_of_Mind_Llama3](https://huggingface.co/ResplendentAI/Theory_of_Mind_Llama3) * [MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy](https://huggingface.co/MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy) + [ResplendentAI/Luna_Llama3](https://huggingface.co/ResplendentAI/Luna_Llama3) * [MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy](https://huggingface.co/MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy) + [ResplendentAI/BlueMoon_Llama3](https://huggingface.co/ResplendentAI/BlueMoon_Llama3) * [MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy](https://huggingface.co/MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy) + [ResplendentAI/NoWarning_Llama3](https://huggingface.co/ResplendentAI/NoWarning_Llama3) * [MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy](https://huggingface.co/MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy) + [Blackroot/Llama-3-LongStory-LORA](https://huggingface.co/Blackroot/Llama-3-LongStory-LORA) ### Configuration The following YAML configuration was used to produce this model: ```yaml models: - model: MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy+ResplendentAI/Theory_of_Mind_Llama3 - model: MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy+ResplendentAI/Aura_Llama3 - model: MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy+ResplendentAI/Luna_Llama3 - model: MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy+ResplendentAI/BlueMoon_Llama3 - model: MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy+ResplendentAI/NoWarning_Llama3 - model: MrRobotoAI/llama3-8B-Special-Dark-v3.1.1yy+Blackroot/Llama-3-LongStory-LORA merge_method: model_stock base_model: MrRobotoAI/llama3-8B-Special-Dark-v2.0 normalize: true int8_mask: true dtype: float16 ```