Commit
•
6ec3fd1
1
Parent(s):
159ef8a
Update README.md (#1)
Browse files- Update README.md (e479e0274f3c5a2e74436600a46f424daf6ad3e3)
Co-authored-by: Samuele Colombo <[email protected]>
README.md
CHANGED
@@ -54,9 +54,13 @@ Please take it with a pinch of salt as we continue to study Modello Italia.
|
|
54 |
* The model architecture is **based on GPT-NeoX**.
|
55 |
|
56 |
## Results
|
57 |
-
|
58 |
-
|
59 |
-
|
|
|
|
|
|
|
|
|
60 |
|
61 |
## How to use Modello Italia with Hugging Face transformers
|
62 |
|
|
|
54 |
* The model architecture is **based on GPT-NeoX**.
|
55 |
|
56 |
## Results
|
57 |
+
For a detailed comparison of model performance, check out the [Leaderboard for Italian Language Models](https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard).
|
58 |
+
|
59 |
+
Here's a breakdown of the performance metrics:
|
60 |
+
|
61 |
+
| Metric | hellaswag_it acc_norm | arc_it acc_norm | m_mmlu_it 5-shot acc | Average |
|
62 |
+
|:----------------------------|:----------------------|:----------------|:---------------------|:--------|
|
63 |
+
| **Accuracy Normalized** | 0.5679 | 0.3849 | 0.3522 | 0.4350 |
|
64 |
|
65 |
## How to use Modello Italia with Hugging Face transformers
|
66 |
|