Update README.md
Browse files
README.md
CHANGED
@@ -1,16 +1,16 @@
|
|
1 |
-
---
|
2 |
-
library_name: transformers
|
3 |
-
license: mit
|
4 |
-
language:
|
5 |
-
- hi
|
6 |
-
metrics:
|
7 |
-
- pearsonr
|
8 |
-
- spearmanr
|
9 |
-
- accuracy
|
10 |
-
base_model:
|
11 |
-
- meta-llama/Llama-3.1-8B-Instruct
|
12 |
-
pipeline_tag: text-generation
|
13 |
-
---
|
14 |
|
15 |
# Model Card for Hercule
|
16 |
Hercule is a cross-lingual evaluation model introduced as part of the CIA Suite to assess multilingual Large Language Models (LLMs). It addresses the challenge of evaluating multilingual LLMs by using English reference responses to score multilingual outputs.
|
@@ -90,11 +90,10 @@ If you find the following model helpful, please consider citing our paper!
|
|
90 |
**BibTeX:**
|
91 |
|
92 |
```bibtex
|
93 |
-
@
|
94 |
-
|
95 |
-
|
96 |
-
|
97 |
-
|
98 |
-
primaryClass={cs.CL}
|
99 |
}
|
100 |
```
|
|
|
1 |
+
---
|
2 |
+
library_name: transformers
|
3 |
+
license: mit
|
4 |
+
language:
|
5 |
+
- hi
|
6 |
+
metrics:
|
7 |
+
- pearsonr
|
8 |
+
- spearmanr
|
9 |
+
- accuracy
|
10 |
+
base_model:
|
11 |
+
- meta-llama/Llama-3.1-8B-Instruct
|
12 |
+
pipeline_tag: text-generation
|
13 |
+
---
|
14 |
|
15 |
# Model Card for Hercule
|
16 |
Hercule is a cross-lingual evaluation model introduced as part of the CIA Suite to assess multilingual Large Language Models (LLMs). It addresses the challenge of evaluating multilingual LLMs by using English reference responses to score multilingual outputs.
|
|
|
90 |
**BibTeX:**
|
91 |
|
92 |
```bibtex
|
93 |
+
@article{doddapaneni2024crosslingual,
|
94 |
+
title = {Cross-Lingual Auto Evaluation for Assessing Multilingual LLMs},
|
95 |
+
author = {Sumanth Doddapaneni and Mohammed Safi Ur Rahman Khan and Dilip Venkatesh and Raj Dabre and Anoop Kunchukuttan and Mitesh M. Khapra},
|
96 |
+
year = {2024},
|
97 |
+
journal = {arXiv preprint arXiv: 2410.13394}
|
|
|
98 |
}
|
99 |
```
|