--- base_model: - VAGOsolutions/SauerkrautLM-7b-LaserChat - mistralai/Mistral-7B-v0.1 - DRXD1000/Phoenix - hiig-piai/simba-v01c library_name: transformers tags: - mergekit - merge --- # VerwaltungsAnthologie_clear2_7B This model is used as an intermediate model for future merges. It is a merge of 4 pre-trained language models based upon Mistral-7B-v0.1 created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](https://arxiv.org/abs/2306.01708) merge method using [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) as a base. ### Models Merged The following models were included in the merge: * [VAGOsolutions/SauerkrautLM-7b-LaserChat](https://huggingface.co/VAGOsolutions/SauerkrautLM-7b-LaserChat) * [DRXD1000/Phoenix](https://huggingface.co/DRXD1000/Phoenix) * [hiig-piai/simba-v01c](https://huggingface.co/hiig-piai/simba-v01c) ### Configuration The following YAML configuration was used to produce this model: ```yaml # works but never stops models: - model: mistralai/Mistral-7B-v0.1 # No parameters necessary for base model - model: VAGOsolutions/SauerkrautLM-7b-LaserChat parameters: density: 0.53 weight: 0.225 - model: hiig-piai/simba-v01c parameters: density: 0.53 weight: 0.55 - model: DRXD1000/Phoenix parameters: density: 0.53 weight: 0.225 merge_method: dare_ties base_model: mistralai/Mistral-7B-v0.1 parameters: int8_mask: true dtype: bfloat16 name: VerwaltungsAnthologie_clear2_7B ```