sydonayrex
/

Barely-Regal-10.7B-Q6_K-GGUF

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

sydonayrex commited on Jun 9

Commit

33a46f0

•

1 Parent(s): 204ccef

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -22,7 +22,7 @@ The base of this model is Mistral Instruct 0.3 that has been supersized using ta
 In addition to the layer merging, the model has been further fine tuned using SFT using Unsloth to act as a base for further training and experimentation with DPO or ORPO (current DPO project in the process of being trained using Axolotl.)
-If you find the LLM is acting as if it has had a stroke, see if you have flash attn turned off and enable it is so. This seemed to correct any issues I had when running the model in LM Studio.
 GGUFs are available here:

 In addition to the layer merging, the model has been further fine tuned using SFT using Unsloth to act as a base for further training and experimentation with DPO or ORPO (current DPO project in the process of being trained using Axolotl.)
+If you find the LLM is acting as if it has had a stroke, see if you have flash attn turned off and enable it if is off. This seemed to correct any issues I had when running the model in LM Studio.
 GGUFs are available here: