Update README.md
Browse files
README.md
CHANGED
@@ -12,18 +12,6 @@ Platypus-13B is an instruction fine-tuned model based on the LLaMA2-13B transfor
|
|
12 |
|
13 |
![Platty](./Best_Platty_small.jpeg)
|
14 |
|
15 |
-
### Benchmark Metrics
|
16 |
-
|
17 |
-
| Metric | Value |
|
18 |
-
|-----------------------|-------|
|
19 |
-
| MMLU (5-shot) | 56.70 |
|
20 |
-
| ARC (25-shot) | 61.26 |
|
21 |
-
| HellaSwag (10-shot) | 82.56 |
|
22 |
-
| TruthfulQA (0-shot) | 44.86 |
|
23 |
-
| Avg. | 61.35 |
|
24 |
-
|
25 |
-
We use state-of-the-art [Language Model Evaluation Harness](https://github.com/EleutherAI/lm-evaluation-harness) to run the benchmark tests above, using the same version as the HuggingFace LLM Leaderboard. Please see below for detailed instructions on reproducing benchmark results.
|
26 |
-
|
27 |
### Model Details
|
28 |
|
29 |
* **Trained by**: Cole Hunter & Ariel Lee
|
|
|
12 |
|
13 |
![Platty](./Best_Platty_small.jpeg)
|
14 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
15 |
### Model Details
|
16 |
|
17 |
* **Trained by**: Cole Hunter & Ariel Lee
|