--- base_model: [] library_name: transformers tags: - mergekit - merge --- # Maid-Reborn-v22-10B This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using Maid-Reborn-v2-Remerge as a base. ### Models Merged The following models were included in the merge: * Maid-Reborn-v2.1-Remerge ### Configuration The following YAML configuration was used to produce this model: ```yaml models: # Top-Loyal-Bruins-Maid-DARE-7B - model: Maid-Reborn-v2-Remerge # no parameters necessary for base model - model: Maid-Reborn-v2.1-Remerge parameters: weight: 0.50 density: 0.5 - model: Maid-Reborn-v2.1-Remerge parameters: weight: 0.50 density: 0.5 merge_method: dare_ties base_model: Maid-Reborn-v2-Remerge parameters: int8_mask: true dtype: bfloat16 name: Eclectic Maid ```