Initial release

.gitattributes

@@ -4,6 +4,7 @@
 *.bz2 filter=lfs diff=lfs merge=lfs -text
 *.ckpt filter=lfs diff=lfs merge=lfs -text
 *.ftz filter=lfs diff=lfs merge=lfs -text
+*.gguf filter=lfs diff=lfs merge=lfs -text
 *.gz filter=lfs diff=lfs merge=lfs -text
 *.h5 filter=lfs diff=lfs merge=lfs -text
 *.joblib filter=lfs diff=lfs merge=lfs -text

Magnolia-v1-12B.Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:76c310b5326107d86216dc48ab206f2e2fdde055907c518b15e74c634b097c5e
+size 7477204064

Magnolia-v1-12B.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2095e101b7f3fa992a6cfc33403360e66368a13bbe7d99d8fb435146f56c94b4
+size 8727630944

Magnolia-v1-12B.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8d79850a5f3b5d5acf4196b6f967feaab9cab97712ace3430a1a6e92aa4f8582
+size 10056209504

Magnolia-v1-12B.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:507d73c81da3f3f2316d6251ac49b3a374be7b7492f5b8d10f3011f05e583cda
+size 13022368864

README.md

@@ -0,0 +1,55 @@
+---
+base_model:
+- grimjim/magnum-consolidatum-v1-12b
+- grimjim/mistralai-Mistral-Nemo-Instruct-2407
+library_name: transformers
+tags:
+- mergekit
+- merge
+pipeline_tag: text-generation
+license: apache-2.0
+quanted_by: grimjim
+---
+# Magnolia-v1-12B-GGUF
+
+This repo contains a GGUF quants of a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+The base is a merge of two models trained for variety in text generation.
+Instruct was added in at low weight in order to increase the steerability of the model;
+safety has consequently been reinforced.
+
+Tested at temperature 0.7 and minP 0.01, with ChatML prompting.
+
+Mistral Nemo models tend to have repetition issues in general. For this model at least, various issues can be mitigated somewhat with additional sysprompting, e.g.:
+```
+No passage shall exceed 10 lines of text, with turns limited to a maximum of 5 lines per speaker to ensure snappy and engaging dialog and action.
+Ensure that all punctuation rules are adhered to without the introduction of spurious intervening spaces.
+Avoid redundant phrasing and maintain forward narrative progression by utilizing varied sentence structure, alternative word choices, and active voice.
+Employ descriptive details judiciously, ensuring they serve a purpose in advancing the story or revealing character or touching upon setting.
+```
+
+## Merge Details
+### Merge Method
+
+This model was merged using the SLERP merge method.
+
+### Models Merged
+
+The following models were included in the merge:
+* [grimjim/magnum-consolidatum-v1-12b](https://huggingface.co/grimjim/magnum-consolidatum-v1-12b)
+* [grimjim/mistralai-Mistral-Nemo-Instruct-2407](https://huggingface.co/grimjim/mistralai-Mistral-Nemo-Instruct-2407)
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+models:
+  - model: grimjim/mistralai-Mistral-Nemo-Instruct-2407
+  - model: grimjim/magnum-consolidatum-v1-12b
+merge_method: slerp
+base_model: grimjim/mistralai-Mistral-Nemo-Instruct-2407
+parameters:
+  t:
+   - value: 0.1
+dtype: bfloat16
+```