munish0838 commited on
Commit
ab08169
1 Parent(s): e2053e7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +74 -2
README.md CHANGED
@@ -3,7 +3,9 @@
3
  license: apache-2.0
4
  pipeline_tag: text-generation
5
  inference: false
6
- base_model: 0-hero/Matter-0.1-7B
 
 
7
  language:
8
  - en
9
  library_name: transformers
@@ -11,4 +13,74 @@ tags:
11
  - mistral
12
  - conversational
13
  - text-generation-inference
14
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  license: apache-2.0
4
  pipeline_tag: text-generation
5
  inference: false
6
+ # base_model: 0-hero/Matter-0.1-7B
7
+ datasets:
8
+ - 0-hero/Matter-0.1
9
  language:
10
  - en
11
  library_name: transformers
 
13
  - mistral
14
  - conversational
15
  - text-generation-inference
16
+ ---
17
+
18
+ ## Matter 7B - 0.1 (Mistral 7B Finetune)
19
+
20
+ ## This is the GGUF version of the model, made for the llama.cpp inference engine.
21
+
22
+ Matter 7B is full-finetune on the [Matter dataset](https://huggingface.co/datasets/0-hero/Matter-0.1), which is curated from over 35 datsets analyzing >6B tokens
23
+
24
+ ### Training
25
+
26
+ Prompt format: This model uses ChatML prompt format.
27
+ ```
28
+ <|im_start|>system
29
+ You are a helpful AI assistant.<|im_end|>
30
+ <|im_start|>user
31
+ {prompt}<|im_end|>
32
+ <|im_start|>assistant
33
+ ```
34
+ ### Function Calling
35
+
36
+ Model also supports function calling. Additional tokens for function calling
37
+
38
+ Model function call tokens
39
+ - <|begin_func|> - Function call start token
40
+ - <|end_func|> - Function call end token
41
+
42
+ Function call response tokens
43
+ - <|begin_func_response|> - Function response start token
44
+ - <|end_func_response|> - Function response end token
45
+
46
+ Example
47
+ ```
48
+ <|im_start|>system
49
+ You are a helpful assistant with access to the following functions. Use them if required -
50
+ { "name": "get_news_headlines",
51
+ "description": "Get the latest news headlines",
52
+ "parameters":
53
+ { "type": "object",
54
+ "properties":
55
+ { "country":
56
+ { "type": "string",
57
+ "description": "The country for which to fetch news"
58
+ }
59
+ },
60
+ "required": [ "country" ]
61
+ }
62
+ }
63
+ <|im_end|>
64
+ <|im_start|>user
65
+ Can you tell me the latest news headlines for the United States?<|im_end|>
66
+ <|im_start|>assistant
67
+ <|begin_func|>{"name": "get_news_headlines", "arguments": '{"country": "United States"}'}<|end_func|><|im_end|>
68
+ <|im_start|>user
69
+ <|begin_func_response|>{
70
+ "headlines":
71
+ [
72
+ "Biden announces new vaccine mandates",
73
+ "Hurricane Ida devastates Louisiana",
74
+ "Apple unveils new iPhone",
75
+ "NASA's Perseverance rover collects first Mars rock sample"
76
+ ]
77
+ }<|end_func_response|>
78
+ <|im_end|>
79
+ <|im_start|>assistant
80
+ Here are the latest news headlines for the United States:
81
+ 1. Biden announces new vaccine mandates
82
+ 2. Hurricane Ida devastates Louisiana
83
+ 3. Apple unveils new iPhone
84
+ 4. NASA's Perseverance rover collects first Mars rock sample
85
+ <|im_end|>
86
+ ```