MaziyarPanahi commited on
Commit
3aebcac
1 Parent(s): b709d2b

Update README.md (#9)

Browse files

- Update README.md (ed3146df3261c0ce1f882140c9e19eea72778c29)

Files changed (1) hide show
  1. README.md +18 -18
README.md CHANGED
@@ -20,7 +20,7 @@ inference: false
20
  model_creator: MaziyarPanahi
21
  quantized_by: MaziyarPanahi
22
  model-index:
23
- - name: Phi-3-mini-4k-instruct-v0.2
24
  results:
25
  - task:
26
  type: text-generation
@@ -37,7 +37,7 @@ model-index:
37
  value: 62.8
38
  name: normalized accuracy
39
  source:
40
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/Phi-3-mini-4k-instruct-v0.2
41
  name: Open LLM Leaderboard
42
  - task:
43
  type: text-generation
@@ -53,7 +53,7 @@ model-index:
53
  value: 80.76
54
  name: normalized accuracy
55
  source:
56
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/Phi-3-mini-4k-instruct-v0.2
57
  name: Open LLM Leaderboard
58
  - task:
59
  type: text-generation
@@ -70,7 +70,7 @@ model-index:
70
  value: 69.1
71
  name: accuracy
72
  source:
73
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/Phi-3-mini-4k-instruct-v0.2
74
  name: Open LLM Leaderboard
75
  - task:
76
  type: text-generation
@@ -86,7 +86,7 @@ model-index:
86
  - type: mc2
87
  value: 59.97
88
  source:
89
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/Phi-3-mini-4k-instruct-v0.2
90
  name: Open LLM Leaderboard
91
  - task:
92
  type: text-generation
@@ -103,7 +103,7 @@ model-index:
103
  value: 72.45
104
  name: accuracy
105
  source:
106
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/Phi-3-mini-4k-instruct-v0.2
107
  name: Open LLM Leaderboard
108
  - task:
109
  type: text-generation
@@ -120,7 +120,7 @@ model-index:
120
  value: 73.62
121
  name: accuracy
122
  source:
123
- url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/Phi-3-mini-4k-instruct-v0.2
124
  name: Open LLM Leaderboard
125
  - task:
126
  type: text-generation
@@ -135,7 +135,7 @@ model-index:
135
  value: 50.69
136
  name: strict accuracy
137
  source:
138
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/Phi-3-mini-4k-instruct-v0.2
139
  name: Open LLM Leaderboard
140
  - task:
141
  type: text-generation
@@ -150,7 +150,7 @@ model-index:
150
  value: 37.73
151
  name: normalized accuracy
152
  source:
153
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/Phi-3-mini-4k-instruct-v0.2
154
  name: Open LLM Leaderboard
155
  - task:
156
  type: text-generation
@@ -165,7 +165,7 @@ model-index:
165
  value: 2.34
166
  name: exact match
167
  source:
168
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/Phi-3-mini-4k-instruct-v0.2
169
  name: Open LLM Leaderboard
170
  - task:
171
  type: text-generation
@@ -180,7 +180,7 @@ model-index:
180
  value: 9.51
181
  name: acc_norm
182
  source:
183
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/Phi-3-mini-4k-instruct-v0.2
184
  name: Open LLM Leaderboard
185
  - task:
186
  type: text-generation
@@ -195,7 +195,7 @@ model-index:
195
  value: 7.7
196
  name: acc_norm
197
  source:
198
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/Phi-3-mini-4k-instruct-v0.2
199
  name: Open LLM Leaderboard
200
  - task:
201
  type: text-generation
@@ -212,23 +212,23 @@ model-index:
212
  value: 31.27
213
  name: accuracy
214
  source:
215
- url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/Phi-3-mini-4k-instruct-v0.2
216
  name: Open LLM Leaderboard
217
  ---
218
 
219
  <img src="./phi-3-instruct.webp" alt="Phi-3 Logo" width="500" style="margin-left:'auto' margin-right:'auto' display:'block'"/>
220
 
221
 
222
- # MaziyarPanahi/Phi-3-mini-4k-instruct-v0.2
223
 
224
  This model is a fine-tune (DPO) of `microsoft/Phi-3-mini-4k-instruct` model.
225
 
226
  # ⚡ Quantized GGUF
227
 
228
- All GGUF models are available here: [MaziyarPanahi/Phi-3-mini-4k-instruct-v0.2-GGUF](https://huggingface.co/MaziyarPanahi/Phi-3-mini-4k-instruct-v0.2-GGUF)
229
 
230
  # 🏆 [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
231
- Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_MaziyarPanahi__Phi-3-mini-4k-instruct-v0.2)
232
 
233
  | Metric |Value|
234
  |-------------------|----:|
@@ -271,7 +271,7 @@ This model uses `ChatML` prompt template:
271
 
272
  # How to use
273
 
274
- You can use this model by using `MaziyarPanahi/Phi-3-mini-4k-instruct-v0.2` as the model name in Hugging Face's
275
  transformers library.
276
 
277
  ```python
@@ -279,7 +279,7 @@ from transformers import AutoModelForCausalLM, AutoTokenizer, TextStreamer
279
  from transformers import pipeline
280
  import torch
281
 
282
- model_id = "MaziyarPanahi/Phi-3-mini-4k-instruct-v0.2"
283
 
284
  model = AutoModelForCausalLM.from_pretrained(
285
  model_id,
 
20
  model_creator: MaziyarPanahi
21
  quantized_by: MaziyarPanahi
22
  model-index:
23
+ - name: calme-2.2-phi3-4b
24
  results:
25
  - task:
26
  type: text-generation
 
37
  value: 62.8
38
  name: normalized accuracy
39
  source:
40
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/calme-2.2-phi3-4b
41
  name: Open LLM Leaderboard
42
  - task:
43
  type: text-generation
 
53
  value: 80.76
54
  name: normalized accuracy
55
  source:
56
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/calme-2.2-phi3-4b
57
  name: Open LLM Leaderboard
58
  - task:
59
  type: text-generation
 
70
  value: 69.1
71
  name: accuracy
72
  source:
73
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/calme-2.2-phi3-4b
74
  name: Open LLM Leaderboard
75
  - task:
76
  type: text-generation
 
86
  - type: mc2
87
  value: 59.97
88
  source:
89
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/calme-2.2-phi3-4b
90
  name: Open LLM Leaderboard
91
  - task:
92
  type: text-generation
 
103
  value: 72.45
104
  name: accuracy
105
  source:
106
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/calme-2.2-phi3-4b
107
  name: Open LLM Leaderboard
108
  - task:
109
  type: text-generation
 
120
  value: 73.62
121
  name: accuracy
122
  source:
123
+ url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=MaziyarPanahi/calme-2.2-phi3-4b
124
  name: Open LLM Leaderboard
125
  - task:
126
  type: text-generation
 
135
  value: 50.69
136
  name: strict accuracy
137
  source:
138
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/calme-2.2-phi3-4b
139
  name: Open LLM Leaderboard
140
  - task:
141
  type: text-generation
 
150
  value: 37.73
151
  name: normalized accuracy
152
  source:
153
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/calme-2.2-phi3-4b
154
  name: Open LLM Leaderboard
155
  - task:
156
  type: text-generation
 
165
  value: 2.34
166
  name: exact match
167
  source:
168
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/calme-2.2-phi3-4b
169
  name: Open LLM Leaderboard
170
  - task:
171
  type: text-generation
 
180
  value: 9.51
181
  name: acc_norm
182
  source:
183
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/calme-2.2-phi3-4b
184
  name: Open LLM Leaderboard
185
  - task:
186
  type: text-generation
 
195
  value: 7.7
196
  name: acc_norm
197
  source:
198
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/calme-2.2-phi3-4b
199
  name: Open LLM Leaderboard
200
  - task:
201
  type: text-generation
 
212
  value: 31.27
213
  name: accuracy
214
  source:
215
+ url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=MaziyarPanahi/calme-2.2-phi3-4b
216
  name: Open LLM Leaderboard
217
  ---
218
 
219
  <img src="./phi-3-instruct.webp" alt="Phi-3 Logo" width="500" style="margin-left:'auto' margin-right:'auto' display:'block'"/>
220
 
221
 
222
+ # MaziyarPanahi/calme-2.2-phi3-4b
223
 
224
  This model is a fine-tune (DPO) of `microsoft/Phi-3-mini-4k-instruct` model.
225
 
226
  # ⚡ Quantized GGUF
227
 
228
+ All GGUF models are available here: [MaziyarPanahi/calme-2.2-phi3-4b-GGUF](https://huggingface.co/MaziyarPanahi/calme-2.2-phi3-4b-GGUF)
229
 
230
  # 🏆 [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
231
+ Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_MaziyarPanahi__calme-2.2-phi3-4b)
232
 
233
  | Metric |Value|
234
  |-------------------|----:|
 
271
 
272
  # How to use
273
 
274
+ You can use this model by using `MaziyarPanahi/calme-2.2-phi3-4b` as the model name in Hugging Face's
275
  transformers library.
276
 
277
  ```python
 
279
  from transformers import pipeline
280
  import torch
281
 
282
+ model_id = "MaziyarPanahi/calme-2.2-phi3-4b"
283
 
284
  model = AutoModelForCausalLM.from_pretrained(
285
  model_id,