grimjim
/

kunoichi-lemon-royale-v3-32K-7B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

grimjim commited on May 29

Commit

7dddf6b

•

1 Parent(s): 50f6b35

Update README.md

Added link to GGUF quants

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -20,6 +20,7 @@ Tested with ChatML instruct templates, temperature 1.0, and minP 0.02. Practical
 The additional model merge weight of 0.02 was deliberately chosen to be on par with the minP setting.
 - Full weights: [grimjim/kunoichi-lemon-royale-v3-32K-7B](https://huggingface.co/grimjim/kunoichi-lemon-royale-v3-32K-7B)
 ## Merge Details
 ### Merge Method

 The additional model merge weight of 0.02 was deliberately chosen to be on par with the minP setting.
 - Full weights: [grimjim/kunoichi-lemon-royale-v3-32K-7B](https://huggingface.co/grimjim/kunoichi-lemon-royale-v3-32K-7B)
+- GGUF quants: [grimjim/kunoichi-lemon-royale-v3-32K-7B-GGUF](https://huggingface.co/grimjim/kunoichi-lemon-royale-v3-32K-7B-GGUF)
 ## Merge Details
 ### Merge Method