JeongwonChoi
commited on
Commit
•
a7f6bde
1
Parent(s):
a6d62e3
Update README.md
Browse files
README.md
CHANGED
@@ -59,12 +59,13 @@ text = """\
|
|
59 |
|
60 |
### **[Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)**
|
61 |
|
62 |
-
| Task |
|
63 |
-
| :--------------- |
|
64 |
-
| kobest_boolq |
|
65 |
-
| kobest_copa |
|
66 |
-
| kobest_hellaswag |
|
67 |
-
| kobest_sentineg |
|
|
|
68 |
|
69 |
### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
|
70 |
|
|
|
59 |
|
60 |
### **[Ko LM Eval Harnesss](https://github.com/Beomi/ko-lm-evaluation-harness)**
|
61 |
|
62 |
+
| Task | 0-shot | 5-shot | 10-shot | 50-shot |
|
63 |
+
| :--------------- | ------------: | -------------: | -----------: | -------------: |
|
64 |
+
| kobest_boolq | 0.334282 | 0.891367 | 0.896755 | 0.884441 |
|
65 |
+
| kobest_copa | 0.697763 | 0.716762 | 0.724769 | 0.751746 |
|
66 |
+
| kobest_hellaswag | 0.432047 | 0.458301 | 0.443993 | 0.458232 |
|
67 |
+
| kobest_sentineg | 0.49353 | 0.954657 | 0.964735 | 0.949606 |
|
68 |
+
| **Average** | **0.4894055** | **0.75527175** | **0.757563** | **0.76100625** |
|
69 |
|
70 |
### **[Ko-LLM-Leaderboard](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)**
|
71 |
|