Removed math

README.md

@@ -546,7 +546,7 @@ The dataset does not allow for external contributions.
 
 ### Gold-standard benchmarks
 
-Evaluation is done using the Language Model Evaluation Harness (Gao et al., 2024). We evaluate on a set of tasks taken from [SpanishBench](https://github.com/EleutherAI/lm-evaluation-harness/pull/2157), [CatalanBench](https://github.com/EleutherAI/lm-evaluation-harness/pull/2154), [BasqueBench](https://github.com/EleutherAI/lm-evaluation-harness/pull/2153) and [GalicianBench](https://github.com/EleutherAI/lm-evaluation-harness/pull/2155). These benchmarks include both new and existing tasks and datasets. In the tables below, we include the results in a selection of evaluation datasets that represent model's performance across a variety of tasks within these benchmarks. 
+Evaluation is done using the Language Model Evaluation Harness (Gao et al., 2024). We evaluate on a set of tasks taken from [SpanishBench](https://github.com/EleutherAI/lm-evaluation-harness/pull/2157), [CatalanBench](https://github.com/EleutherAI/lm-evaluation-harness/pull/2154), [BasqueBench](https://github.com/EleutherAI/lm-evaluation-harness/pull/2153) and [GalicianBench](https://github.com/EleutherAI/lm-evaluation-harness/pull/2155). We also use English tasks already available on the LM Evaluation Harness. These benchmarks include both new and existing tasks and datasets. In the tables below, we include the results in a selection of evaluation datasets that represent model's performance across a variety of tasks within these benchmarks. 
 
 We only use tasks that are either human generated, human translated, or with a strong human-in-the-loop (i.e., machine translation followed by professional revision or machine generation followed by human revision and annotation). This is the reason behind the variety in number of tasks reported across languages. As more tasks that fulfill these requirements are published, we will update the presented results. We also intend to expand the evaluation to other languages, as long as the datasets meet our quality standards.
 
@@ -574,12 +574,6 @@ All results reported below are on a 5-shot setting.
     <td>acc</td>
     <td>74.06</td>
   </tr>
-  <tr>
-    <td>Math</td>
-    <td>mgsm_direct_es</td>
-    <td>em</td>
-    <td>4</td>
-  </tr>
   <tr>
     <td rowspan="2">NLI</td>
     <td>wnli_es</td>
@@ -633,12 +627,6 @@ All results reported below are on a 5-shot setting.
     <td>acc</td>
     <td>73.73</td>
   </tr>
-  <tr>
-    <td>Math</td>
-    <td>mgsm_direct_ca</td>
-    <td>em</td>
-    <td>6</td>
-  </tr>
   <tr>
     <td rowspan="2">NLI</td>
     <td>wnli_ca</td>
@@ -657,7 +645,7 @@ All results reported below are on a 5-shot setting.
     <td>64.88</td>
   </tr>
   <tr>
-    <td> paws_ca</td>
+    <td>paws_ca</td>
     <td>acc</td>
     <td>61.5</td>
   </tr>
@@ -668,22 +656,22 @@ All results reported below are on a 5-shot setting.
     <td>69.23</td>
   </tr>
   <tr>
-    <td> arc_ca_challenge</td>
+    <td>arc_ca_challenge</td>
     <td>acc</td>
     <td>44.54</td>
   </tr>
   <tr>
-    <td> openbookqa_ca</td>
+    <td>openbookqa_ca</td>
     <td>acc</td>
     <td>36.8</td>
   </tr>
   <tr>
-    <td> piqa_ca</td>
+    <td>piqa_ca</td>
     <td>acc</td>
     <td>70.35</td>
   </tr>
   <tr>
-    <td> siqa_ca</td>
+    <td>siqa_ca</td>
     <td>acc</td>
     <td>48.26</td>
   </tr>
@@ -716,12 +704,6 @@ All results reported below are on a 5-shot setting.
     <td>acc</td>
     <td>64.79</td>
   </tr>
-  <tr>
-    <td>Math</td>
-    <td>mgsm_direct_eu</td>
-    <td>em</td>
-    <td>6</td>
-  </tr>
   <tr>
     <td rowspan="2">NLI</td>
     <td>wnli_eu</td>
@@ -773,12 +755,6 @@ All results reported below are on a 5-shot setting.
     <th>Result</th>
   </tr></thead>
 <tbody>
-  <tr>
-    <td>Math</td>
-    <td>mgsm_direct_gl</td>
-    <td>em</td>
-    <td>48</td>
-  </tr>
   <tr>
     <td rowspan="2">Paraphrasing</td>
     <td>parafrases_gl</td>
@@ -826,12 +802,6 @@ All results reported below are on a 5-shot setting.
     <td>acc</td>
     <td>79.22</td>
   </tr>
-  <tr>
-    <td>Math</td>
-    <td>mgsm_direct_en *</td>
-    <td>em</td>
-    <td>8</td>
-  </tr>
   <tr>
     <td rowspan="2">NLI</td>
     <td>wnli</td>