ghaddara commited on
Commit
78a4c1d
1 Parent(s): 7e07729

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +24 -0
README.md CHANGED
@@ -1,3 +1,27 @@
1
  ---
2
  license: apache-2.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
  ---
4
+
5
+ # Overview
6
+
7
+ <p align="center">
8
+ <img src="https://avatars.githubusercontent.com/u/12619994?s=200&v=4" width="150">
9
+ </p>
10
+
11
+ <!-- -------------------------------------------------------------------------------- -->
12
+
13
+ This model is **only compatible** with the code in [this github repo](https://github.com/huawei-noah/Pretrained-Language-Model/tree/master/JABER-PyTorch) (not supported by the [Transformers](https://github.com/huggingface/transformers) library)
14
+
15
+ ## Citation
16
+
17
+ Please cite the following paper when using our code and model:
18
+
19
+ ``` bibtex
20
+ @article{ghaddar2024importance,
21
+ title={On the importance of Data Scale in Pretraining Arabic Language Models},
22
+ author={Ghaddar, Abbas and Langlais, Philippe and Rezagholizadeh, Mehdi and Chen, Boxing},
23
+ journal={arXiv preprint arXiv:todo},
24
+ year={2024}
25
+ }
26
+ ```
27
+