--- base_model: - Bllossom/llama-3-Korean-Bllossom-70B library_name: transformers tags: - mergekit - merge --- About the JayLee "AsianSoul" "A leader who can make you rich" Screenshot-2024-05-18-at-11-08-12-PM ### About this model This is a 128B model based on Blossom/llama-3-Korean-Bllossom-70B. To know more about the base model, check below link. I hope this 120B is a helpful model for your future. Collaboration is always welcome. ### Models Merged The following models were included in the merge: * [Bllossom/llama-3-Korean-Bllossom-70B](https://huggingface.co/Bllossom/llama-3-Korean-Bllossom-70B) ### Configuration The following YAML configuration was used to produce this model: ```yaml slices: - sources: - layer_range: [0, 20] model: Bllossom/llama-3-Korean-Bllossom-70B - sources: - layer_range: [10, 30] model: Bllossom/llama-3-Korean-Bllossom-70B - sources: - layer_range: [20, 40] model: Bllossom/llama-3-Korean-Bllossom-70B - sources: - layer_range: [30, 50] model: Bllossom/llama-3-Korean-Bllossom-70B - sources: - layer_range: [40, 60] model: Bllossom/llama-3-Korean-Bllossom-70B - sources: - layer_range: [50, 70] model: Bllossom/llama-3-Korean-Bllossom-70B - sources: - layer_range: [60, 80] model: Bllossom/llama-3-Korean-Bllossom-70B merge_method: passthrough dtype: float16 ```