Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
tasks descriptions
Browse files- src/about.py +24 -22
src/about.py
CHANGED
@@ -70,28 +70,30 @@ or join our [Discord SpeakLeash](https://discord.gg/3G9DVM39)
|
|
70 |
* add inference time
|
71 |
* add metadata for models (e.g. #Params)
|
72 |
* add more tasks
|
73 |
-
*
|
74 |
-
|
75 |
-
##
|
76 |
-
|
77 |
-
|
78 |
-
|
79 |
-
|
80 |
-
-
|
81 |
-
-
|
82 |
-
-
|
83 |
-
-
|
84 |
-
|
85 |
-
|
86 |
-
|
87 |
-
-
|
88 |
-
-
|
89 |
-
|
90 |
-
|
91 |
-
|
92 |
-
|
93 |
-
|
94 |
-
|
|
|
|
|
95 |
|
96 |
|
97 |
## Reproducibility
|
|
|
70 |
* add inference time
|
71 |
* add metadata for models (e.g. #Params)
|
72 |
* add more tasks
|
73 |
+
* use model templates
|
74 |
+
|
75 |
+
## Tasks
|
76 |
+
|
77 |
+
| Task | Dataset | Metric | Type |
|
78 |
+
|---------------------------------|---------------------------------------|-----------|-----------------|
|
79 |
+
| belebele_pol_Latn | facebook/belebele | accuracy | multiple_choice |
|
80 |
+
| polemo2_in | allegro/klej-polemo2-in | accuracy | generate_until |
|
81 |
+
| polemo2_in_multiple_choice | allegro/klej-polemo2-in | accuracy | multiple_choice |
|
82 |
+
| polemo2_out | allegro/klej-polemo2-out | accuracy | generate_until |
|
83 |
+
| polemo2_out_multiple_choice | allegro/klej-polemo2-out | accuracy | multiple_choice |
|
84 |
+
| polish_8tags_multiple_choice | sdadas/8tags | accuracy | multiple_choice |
|
85 |
+
| polish_8tags_regex | sdadas/8tags | accuracy | generate_until |
|
86 |
+
| polish_belebele_regex | facebook/belebele | accuracy | generate_until |
|
87 |
+
| polish_dyk_multiple_choice | allegro/klej-dyk | binary F1 | multiple_choice |
|
88 |
+
| polish_dyk_regex | allegro/klej-dyk | binary F1 | generate_until |
|
89 |
+
| polish_ppc_multiple_choice | sdadas/ppc | accuracy | multiple_choice |
|
90 |
+
| polish_ppc_regex | sdadas/ppc | accuracy | generate_until |
|
91 |
+
| polish_psc_multiple_choice | allegro/klej-psc | binary F1 | multiple_choice |
|
92 |
+
| polish_psc_regex | allegro/klej-psc | binary F1 | generate_until |
|
93 |
+
| polish_cbd_multiple_choice | ptaszynski/PolishCyberbullyingDataset | macro F1 | multiple_choice |
|
94 |
+
| polish_cbd_regex | ptaszynski/PolishCyberbullyingDataset | macro F1 | generate_until |
|
95 |
+
| polish_klej_ner_multiple_choice | allegro/klej-nkjp-ner | accuracy | multiple_choice |
|
96 |
+
| polish_klej_ner_regex | allegro/klej-nkjp-ner | accuracy | generate_until |
|
97 |
|
98 |
|
99 |
## Reproducibility
|