Upload folder using huggingface_hub

.gitattributes

@@ -1,35 +1,9 @@
-*.7z filter=lfs diff=lfs merge=lfs -text
-*.arrow filter=lfs diff=lfs merge=lfs -text
-*.bin filter=lfs diff=lfs merge=lfs -text
-*.bz2 filter=lfs diff=lfs merge=lfs -text
-*.ckpt filter=lfs diff=lfs merge=lfs -text
-*.ftz filter=lfs diff=lfs merge=lfs -text
-*.gz filter=lfs diff=lfs merge=lfs -text
-*.h5 filter=lfs diff=lfs merge=lfs -text
-*.joblib filter=lfs diff=lfs merge=lfs -text
-*.lfs.* filter=lfs diff=lfs merge=lfs -text
-*.mlmodel filter=lfs diff=lfs merge=lfs -text
-*.model filter=lfs diff=lfs merge=lfs -text
-*.msgpack filter=lfs diff=lfs merge=lfs -text
-*.npy filter=lfs diff=lfs merge=lfs -text
-*.npz filter=lfs diff=lfs merge=lfs -text
-*.onnx filter=lfs diff=lfs merge=lfs -text
-*.ot filter=lfs diff=lfs merge=lfs -text
-*.parquet filter=lfs diff=lfs merge=lfs -text
-*.pb filter=lfs diff=lfs merge=lfs -text
-*.pickle filter=lfs diff=lfs merge=lfs -text
-*.pkl filter=lfs diff=lfs merge=lfs -text
-*.pt filter=lfs diff=lfs merge=lfs -text
-*.pth filter=lfs diff=lfs merge=lfs -text
-*.rar filter=lfs diff=lfs merge=lfs -text
-*.safetensors filter=lfs diff=lfs merge=lfs -text
-saved_model/**/* filter=lfs diff=lfs merge=lfs -text
-*.tar.* filter=lfs diff=lfs merge=lfs -text
-*.tar filter=lfs diff=lfs merge=lfs -text
-*.tflite filter=lfs diff=lfs merge=lfs -text
-*.tgz filter=lfs diff=lfs merge=lfs -text
-*.wasm filter=lfs diff=lfs merge=lfs -text
-*.xz filter=lfs diff=lfs merge=lfs -text
-*.zip filter=lfs diff=lfs merge=lfs -text
-*.zst filter=lfs diff=lfs merge=lfs -text
-*tfevents* filter=lfs diff=lfs merge=lfs -text
+CapybaraHermes-2.5-Mistral-7B-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+CapybaraHermes-2.5-Mistral-7B-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+CapybaraHermes-2.5-Mistral-7B-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+CapybaraHermes-2.5-Mistral-7B-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+CapybaraHermes-2.5-Mistral-7B-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+CapybaraHermes-2.5-Mistral-7B-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+CapybaraHermes-2.5-Mistral-7B-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+CapybaraHermes-2.5-Mistral-7B-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+CapybaraHermes-2.5-Mistral-7B-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

CapybaraHermes-2.5-Mistral-7B-Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:406a71bc92780cf5faba524d16399739030fd267b0d1945faa0406c42679b2b5
+size 3822034912

CapybaraHermes-2.5-Mistral-7B-Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7a30fa0ba3d9b9e62ffab72bedfd65d19f9d3914a73890350d658b1107953fa7
+size 3518996448

CapybaraHermes-2.5-Mistral-7B-Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5b4e21cc1bf696bd2ca63a0d9ffc2cbd895be4991fe989872f994fc58f6599dd
+size 3164577760

CapybaraHermes-2.5-Mistral-7B-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:46510b536bfaa60a3139289c043753b09065b1a83bf33f9e0b53c459e8190076
+size 4368450592

CapybaraHermes-2.5-Mistral-7B-Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b5792944e384f4415c825c2fd07f2606ebb2868aa633aa32a36af2aa99e2a3f9
+size 4140385312

CapybaraHermes-2.5-Mistral-7B-Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:09aa4342dad645156d8037be9a9ec27cceb34d94399343797586b08dabc9777d
+size 5131421728

CapybaraHermes-2.5-Mistral-7B-Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e4ebdc5852d2665474cb064c23f56115a03bd3b05f51194e799fd46eb417fa9d
+size 4997728288

CapybaraHermes-2.5-Mistral-7B-Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:97825da7e775febbc22de4d2cc532ae0d7e2b4ccc930a49bf0d91fbf515f747b
+size 5942078560

CapybaraHermes-2.5-Mistral-7B-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:55b9bccfbf8976368d7f341a5689ee210a393841304d493de2bdb41f61da08d6
+size 7695875040

README.md

@@ -0,0 +1,64 @@
+---
+library_name: trl
+license: apache-2.0
+datasets:
+- argilla/dpo-mix-7k
+language:
+- en
+tags:
+- distilabel
+- dpo
+- rlaif
+- rlhf
+---
+
+# CapybaraHermes-2.5-Mistral-7B
+<div>
+    <img src="https://cdn-uploads.huggingface.co/production/uploads/60420dccc15e823a685f2b03/Vmr0FtTvnny6Snm-UDM_n.png">
+</div>
+
+<p align="center">
+  <a href="https://github.com/argilla-io/distilabel">
+    <img src="https://raw.githubusercontent.com/argilla-io/distilabel/main/docs/assets/distilabel-badge-light.png" alt="Built with Distilabel" width="200" height="32"/>
+  </a>
+</p>
+
+
+This model is the launching partner of the [capybara-dpo dataset](https://huggingface.co/datasets/argilla/distilabel-capybara-dpo-9k-binarized) build with ⚗️ distilabel. It's a preference tuned [OpenHermes-2.5-Mistral-7B](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B). 
+
+CapybaraHermes has been preference tuned with LoRA and TRL for 3 epochs using argilla's [dpo mix 7k](https://huggingface.co/datasets/argilla/dpo-mix-7k). 
+
+To test the impact on multi-turn performance we have used MTBench. We also include the Nous Benchmark results and Mistral-7B-Instruct-v0.2 for reference as it's a strong 7B model on MTBench:
+
+| Model                             | AGIEval | GPT4All | TruthfulQA | Bigbench | MTBench First Turn | MTBench Second Turn | Nous avg. | MTBench avg. |
+|-----------------------------------|---------|---------|------------|----------|------------|-------------|-----------|--------------|
+| argilla/CapybaraHermes-2.5-Mistral-7B     | **43.8**    | **73.35**   | 57.07      | **42.44**    | 8.24375    | **7.5625**      | 54.16     | **7.903125** |
+| teknium/OpenHermes-2.5-Mistral-7B | 42.75   | 72.99   | 52.99      | 40.94    | **8.25**       | 7.2875      | 52.42     | 7.76875      |
+| Mistral-7B-Instruct-v0.2          | 38.5    | 71.64   | **66.82**  | 42.29    | 7.8375     | 7.1         | **54.81** | 7.46875      |
+
+The most interesting aspect in the context of the capybara-dpo dataset is the increased performance in MTBench Second Turn scores.
+
+For the merge lovers, we also preference tuned Beagle14-7B with a mix of capybara-dpo and distilabel orca pairs using the same recipe as NeuralBeagle (see [ YALL - Yet Another LLM Leaderboard](https://huggingface.co/spaces/mlabonne/Yet_Another_LLM_Leaderboard) for reference):
+
+|                                                               Model                                                                |AGIEval|GPT4All|TruthfulQA|Bigbench|Average|
+|------------------------------------------------------------------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
+|[DistilabelBeagle14-7B](https://huggingface.co/dvilasuero/DistilabelBeagle14-7B)|  45.29|  76.92|     71.66|   48.78|  60.66|
+
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
+
+- **Developed by:** Argilla
+- **Shared by [optional]:** Argilla
+- **Model type:** 7B chat model
+- **Language(s) (NLP):** English
+- **License:** Same as OpenHermes
+- **Finetuned from model [optional]:** [OpenHermes-2.5-Mistral-7B](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B)
+

huggingface-metadata.txt

@@ -0,0 +1,8 @@
+url: https://huggingface.co/argilla/CapybaraHermes-2.5-Mistral-7B
+branch: main
+download date: 2024-02-01 00:42:52
+sha256sum:
+    4c5994fc290b42e59e31f99c598b3062d5191677374cdfd90c7f4de449151b8f model-00001-of-00003.safetensors
+    25075f294c955a211455fd139719470c308c246d528a0ea69192024115d34de9 model-00002-of-00003.safetensors
+    86b04972fea1a5aed2a465686c09b4ff89955c5bb4fe7e84d3a6c4845780bf2e model-00003-of-00003.safetensors
+    dadfd56d766715c61d2ef780a525ab43b8e6da4de6865bda3d95fdef5e134055 tokenizer.model