metadata
license: apache-2.0
datasets:
- SeacomSrl/rag-data
language:
- it
Uploaded model
- Developed by: Toti Riccardo
- License: apache-2.0
- Finetuned from model : unsloth/Phi-3-medium-4k-instruct on Seacom/rag-data an italian translated dataset.
Evaluation
For a detailed comparison of model performance, check out the Leaderboard for Italian Language Models.
Here's a breakdown of the performance metrics:
Metric | hellaswag_it acc_norm | arc_it acc_norm | m_mmlu_it 5-shot acc | m_mmlu_pro_it | Average |
---|---|---|---|---|---|
Accuracy Normalized | 69.35 | 49.1 | 69.53 | 0.3913 | 62.66 |