Create README.md

README.md

@@ -0,0 +1,77 @@
+---
+license: apache-2.0
+datasets:
+- 0-hero/Matter-0.2-alpha
+language:
+- en
+base_model: 0-hero/Matter-0.2-7B-DPO
+---
+
+## Matter 7B - 0.2 - DPO - GGUF (Mistral 7B Finetune)
+- This is GGUF quantized evrsion of [Matter-7b-0.2-DPO](https://huggingface.co/0-hero/Matter-0.2-7B-DPO), which is Mistral 7B Finetune
+- [Matter-7b-0.2-DPO](https://huggingface.co/0-hero/Matter-0.2-7B-DPO) is the DPO version of [Matter 7B](https://huggingface.co/0-hero/Matter-0.2-7B) fine-tuned on the [Matter dataset](https://huggingface.co/datasets/0-hero/Matter-0.2-alpha), which is curated from over 35 datsets analyzing >6B tokens
+
+
+### Training
+
+Prompt format: This model uses ChatML prompt format.
+```
+<|im_start|>system
+You are a helpful AI assistant.<|im_end|>
+<|im_start|>user
+{prompt}<|im_end|>
+<|im_start|>assistant
+```
+### Function Calling
+
+Model also supports function calling. Additional tokens for function calling 
+
+Model function call tokens
+- <|begin_func|> - Function call start token
+- <|end_func|> - Function call end token
+
+Function call response tokens
+- <|begin_func_response|> - Function response start token
+- <|end_func_response|> - Function response end token
+
+Example
+```
+<|im_start|>system
+  You are a helpful assistant with access to the following functions. Use them if required -
+  { "name": "get_news_headlines",
+    "description": "Get the latest news headlines",
+    "parameters":
+      { "type": "object",
+        "properties":
+        { "country":
+          { "type": "string",
+            "description": "The country for which to fetch news"
+          }
+        },
+      "required": [ "country" ]
+    }
+  }
+<|im_end|>
+<|im_start|>user
+   Can you tell me the latest news headlines for the United States?<|im_end|>
+<|im_start|>assistant
+  <|begin_func|>{"name": "get_news_headlines", "arguments": '{"country": "United States"}'}<|end_func|><|im_end|>
+<|im_start|>user
+  <|begin_func_response|>{
+    "headlines":
+      [
+        "Biden announces new vaccine mandates",
+        "Hurricane Ida devastates Louisiana",
+        "Apple unveils new iPhone",
+        "NASA's Perseverance rover collects first Mars rock sample"
+      ]
+  }<|end_func_response|>
+<|im_end|>
+<|im_start|>assistant
+  Here are the latest news headlines for the United States:
+  1. Biden announces new vaccine mandates
+  2. Hurricane Ida devastates Louisiana
+  3. Apple unveils new iPhone
+  4. NASA's Perseverance rover collects first Mars rock sample
+<|im_end|>
+```