Fix table in model card
Browse files
README.md
CHANGED
@@ -113,87 +113,46 @@ This model was trained in a collaborative manner by volunteer participants.
|
|
113 |
### Contributors leaderboard
|
114 |
|
115 |
| Rank | Username | Total contributed runtime |
|
116 |
-
|
117 |
|:-------------:|:-------------:|-------------:|
|
118 |
-
|
119 |
| 1|[khalidsaifullaah](https://huggingface.co/khalidsaifullaah)|11 days 21:02:08|
|
120 |
-
|
121 |
| 2|[ishanbagchi](https://huggingface.co/ishanbagchi)|9 days 20:37:00|
|
122 |
-
|
123 |
| 3|[tanmoyio](https://huggingface.co/tanmoyio)|9 days 18:08:34|
|
124 |
-
|
125 |
| 4|[debajit](https://huggingface.co/debajit)|8 days 14:15:10|
|
126 |
-
|
127 |
| 5|[skylord](https://huggingface.co/skylord)|6 days 16:35:29|
|
128 |
-
|
129 |
| 6|[ibraheemmoosa](https://huggingface.co/ibraheemmoosa)|5 days 01:05:57|
|
130 |
-
|
131 |
| 7|[SaulLu](https://huggingface.co/SaulLu)|5 days 00:46:36|
|
132 |
-
|
133 |
| 8|[lhoestq](https://huggingface.co/lhoestq)|4 days 20:11:16|
|
134 |
-
|
135 |
| 9|[nilavya](https://huggingface.co/nilavya)|4 days 08:51:51|
|
136 |
-
|
137 |
|10|[Priyadarshan](https://huggingface.co/Priyadarshan)|4 days 02:28:55|
|
138 |
-
|
139 |
|11|[anuragshas](https://huggingface.co/anuragshas)|3 days 05:00:55|
|
140 |
-
|
141 |
|12|[sujitpal](https://huggingface.co/sujitpal)|2 days 20:52:33|
|
142 |
-
|
143 |
|13|[manandey](https://huggingface.co/manandey)|2 days 16:17:13|
|
144 |
-
|
145 |
|14|[albertvillanova](https://huggingface.co/albertvillanova)|2 days 14:14:31|
|
146 |
-
|
147 |
|15|[justheuristic](https://huggingface.co/justheuristic)|2 days 13:20:52|
|
148 |
-
|
149 |
|16|[w0lfw1tz](https://huggingface.co/w0lfw1tz)|2 days 07:22:48|
|
150 |
-
|
151 |
|17|[smoker](https://huggingface.co/smoker)|2 days 02:52:03|
|
152 |
-
|
153 |
|18|[Soumi](https://huggingface.co/Soumi)|1 days 20:42:02|
|
154 |
-
|
155 |
|19|[Anjali](https://huggingface.co/Anjali)|1 days 16:28:00|
|
156 |
-
|
157 |
|20|[OptimusPrime](https://huggingface.co/OptimusPrime)|1 days 09:16:57|
|
158 |
-
|
159 |
|21|[theainerd](https://huggingface.co/theainerd)|1 days 04:48:57|
|
160 |
-
|
161 |
|22|[yhn112](https://huggingface.co/yhn112)|0 days 20:57:02|
|
162 |
-
|
163 |
|23|[kolk](https://huggingface.co/kolk)|0 days 17:57:37|
|
164 |
-
|
165 |
|24|[arnab](https://huggingface.co/arnab)|0 days 17:54:12|
|
166 |
-
|
167 |
|25|[imavijit](https://huggingface.co/imavijit)|0 days 16:07:26|
|
168 |
-
|
169 |
|26|[osanseviero](https://huggingface.co/osanseviero)|0 days 14:16:45|
|
170 |
-
|
171 |
|27|[subhranilsarkar](https://huggingface.co/subhranilsarkar)|0 days 13:04:46|
|
172 |
-
|
173 |
|28|[sagnik1511](https://huggingface.co/sagnik1511)|0 days 12:24:57|
|
174 |
-
|
175 |
|29|[anindabitm](https://huggingface.co/anindabitm)|0 days 08:56:44|
|
176 |
-
|
177 |
|30|[borzunov](https://huggingface.co/borzunov)|0 days 04:07:35|
|
178 |
-
|
179 |
|31|[thomwolf](https://huggingface.co/thomwolf)|0 days 03:53:15|
|
180 |
-
|
181 |
|32|[priyadarshan](https://huggingface.co/priyadarshan)|0 days 03:40:11|
|
182 |
-
|
183 |
|33|[ali007](https://huggingface.co/ali007)|0 days 03:34:37|
|
184 |
-
|
185 |
|34|[sbrandeis](https://huggingface.co/sbrandeis)|0 days 03:18:16|
|
186 |
-
|
187 |
|35|[Preetha](https://huggingface.co/Preetha)|0 days 03:13:47|
|
188 |
-
|
189 |
|36|[Mrinal](https://huggingface.co/Mrinal)|0 days 03:01:43|
|
190 |
-
|
191 |
|37|[laxya007](https://huggingface.co/laxya007)|0 days 02:18:34|
|
192 |
-
|
193 |
|38|[lewtun](https://huggingface.co/lewtun)|0 days 00:34:43|
|
194 |
-
|
195 |
|39|[Rounak](https://huggingface.co/Rounak)|0 days 00:26:10|
|
196 |
-
|
197 |
|40|[kshmax](https://huggingface.co/kshmax)|0 days 00:06:38|
|
198 |
|
199 |
## Eval results
|
@@ -204,14 +163,10 @@ We evaluate sahajBERT model quality and 2 other model benchmarks ([XLM-R-large](
|
|
204 |
|
205 |
- **NCC**: a multi-class classification task on news Soham News Category Classification dataset from IndicGLUE
|
206 |
|
207 |
-
| Base
|
208 |
-
|
209 |
|:-------------:|:-------------:|:-------------:|
|
210 |
-
|
211 |
|sahajBERT | 95.45 ± 0.53| 91.97 ± 0.47|
|
212 |
-
|
213 |
|[XLM-R-large](https://huggingface.co/xlm-roberta-large) | 96.48 ± 0.22| 90.05 ± 0.38|
|
214 |
-
|
215 |
|[IndicBert](https://huggingface.co/ai4bharat/indic-bert) | 92.52 ± 0.45| 74.46 ± 1.91|
|
216 |
|
217 |
### BibTeX entry and citation info
|
|
|
113 |
### Contributors leaderboard
|
114 |
|
115 |
| Rank | Username | Total contributed runtime |
|
|
|
116 |
|:-------------:|:-------------:|-------------:|
|
|
|
117 |
| 1|[khalidsaifullaah](https://huggingface.co/khalidsaifullaah)|11 days 21:02:08|
|
|
|
118 |
| 2|[ishanbagchi](https://huggingface.co/ishanbagchi)|9 days 20:37:00|
|
|
|
119 |
| 3|[tanmoyio](https://huggingface.co/tanmoyio)|9 days 18:08:34|
|
|
|
120 |
| 4|[debajit](https://huggingface.co/debajit)|8 days 14:15:10|
|
|
|
121 |
| 5|[skylord](https://huggingface.co/skylord)|6 days 16:35:29|
|
|
|
122 |
| 6|[ibraheemmoosa](https://huggingface.co/ibraheemmoosa)|5 days 01:05:57|
|
|
|
123 |
| 7|[SaulLu](https://huggingface.co/SaulLu)|5 days 00:46:36|
|
|
|
124 |
| 8|[lhoestq](https://huggingface.co/lhoestq)|4 days 20:11:16|
|
|
|
125 |
| 9|[nilavya](https://huggingface.co/nilavya)|4 days 08:51:51|
|
|
|
126 |
|10|[Priyadarshan](https://huggingface.co/Priyadarshan)|4 days 02:28:55|
|
|
|
127 |
|11|[anuragshas](https://huggingface.co/anuragshas)|3 days 05:00:55|
|
|
|
128 |
|12|[sujitpal](https://huggingface.co/sujitpal)|2 days 20:52:33|
|
|
|
129 |
|13|[manandey](https://huggingface.co/manandey)|2 days 16:17:13|
|
|
|
130 |
|14|[albertvillanova](https://huggingface.co/albertvillanova)|2 days 14:14:31|
|
|
|
131 |
|15|[justheuristic](https://huggingface.co/justheuristic)|2 days 13:20:52|
|
|
|
132 |
|16|[w0lfw1tz](https://huggingface.co/w0lfw1tz)|2 days 07:22:48|
|
|
|
133 |
|17|[smoker](https://huggingface.co/smoker)|2 days 02:52:03|
|
|
|
134 |
|18|[Soumi](https://huggingface.co/Soumi)|1 days 20:42:02|
|
|
|
135 |
|19|[Anjali](https://huggingface.co/Anjali)|1 days 16:28:00|
|
|
|
136 |
|20|[OptimusPrime](https://huggingface.co/OptimusPrime)|1 days 09:16:57|
|
|
|
137 |
|21|[theainerd](https://huggingface.co/theainerd)|1 days 04:48:57|
|
|
|
138 |
|22|[yhn112](https://huggingface.co/yhn112)|0 days 20:57:02|
|
|
|
139 |
|23|[kolk](https://huggingface.co/kolk)|0 days 17:57:37|
|
|
|
140 |
|24|[arnab](https://huggingface.co/arnab)|0 days 17:54:12|
|
|
|
141 |
|25|[imavijit](https://huggingface.co/imavijit)|0 days 16:07:26|
|
|
|
142 |
|26|[osanseviero](https://huggingface.co/osanseviero)|0 days 14:16:45|
|
|
|
143 |
|27|[subhranilsarkar](https://huggingface.co/subhranilsarkar)|0 days 13:04:46|
|
|
|
144 |
|28|[sagnik1511](https://huggingface.co/sagnik1511)|0 days 12:24:57|
|
|
|
145 |
|29|[anindabitm](https://huggingface.co/anindabitm)|0 days 08:56:44|
|
|
|
146 |
|30|[borzunov](https://huggingface.co/borzunov)|0 days 04:07:35|
|
|
|
147 |
|31|[thomwolf](https://huggingface.co/thomwolf)|0 days 03:53:15|
|
|
|
148 |
|32|[priyadarshan](https://huggingface.co/priyadarshan)|0 days 03:40:11|
|
|
|
149 |
|33|[ali007](https://huggingface.co/ali007)|0 days 03:34:37|
|
|
|
150 |
|34|[sbrandeis](https://huggingface.co/sbrandeis)|0 days 03:18:16|
|
|
|
151 |
|35|[Preetha](https://huggingface.co/Preetha)|0 days 03:13:47|
|
|
|
152 |
|36|[Mrinal](https://huggingface.co/Mrinal)|0 days 03:01:43|
|
|
|
153 |
|37|[laxya007](https://huggingface.co/laxya007)|0 days 02:18:34|
|
|
|
154 |
|38|[lewtun](https://huggingface.co/lewtun)|0 days 00:34:43|
|
|
|
155 |
|39|[Rounak](https://huggingface.co/Rounak)|0 days 00:26:10|
|
|
|
156 |
|40|[kshmax](https://huggingface.co/kshmax)|0 days 00:06:38|
|
157 |
|
158 |
## Eval results
|
|
|
163 |
|
164 |
- **NCC**: a multi-class classification task on news Soham News Category Classification dataset from IndicGLUE
|
165 |
|
166 |
+
| Base pre-trained Model | NER - F1 (mean ± std) | NCC - Accuracy (mean ± std) |
|
|
|
167 |
|:-------------:|:-------------:|:-------------:|
|
|
|
168 |
|sahajBERT | 95.45 ± 0.53| 91.97 ± 0.47|
|
|
|
169 |
|[XLM-R-large](https://huggingface.co/xlm-roberta-large) | 96.48 ± 0.22| 90.05 ± 0.38|
|
|
|
170 |
|[IndicBert](https://huggingface.co/ai4bharat/indic-bert) | 92.52 ± 0.45| 74.46 ± 1.91|
|
171 |
|
172 |
### BibTeX entry and citation info
|