3ebdola commited on
Commit
330dea7
1 Parent(s): e14a9e0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -111,6 +111,10 @@ This is a repo of the language model used for "AdaSL: An Unsupervised Domain Ada
111
 
112
  ### About the Dialectal-Arabic-XLM-R-Base model
113
 
 
 
 
 
114
  We have built a 5 million Tweets corpus from Twitter. The crawled tweets cover the dialects of the four Arabic world regions (EGY, GLF, LEV, and MAG regions), as well as MSA. The collected corpus consists of one million (1M) tweets per Arabic variant. We did not perform any text pre-processing on the tweets, except by removing tweets that have a small length (tweets containing less than four words).
115
 
116
  ### Usage
 
111
 
112
  ### About the Dialectal-Arabic-XLM-R-Base model
113
 
114
+ This model is an trained as a further pre-trained of XLM-RoBERTa base using the Masked-language modeling on a dialectal Arabic corpus.
115
+
116
+ ### About the Dialectal-Arabic-XLM-R-Base model training corpora
117
+
118
  We have built a 5 million Tweets corpus from Twitter. The crawled tweets cover the dialects of the four Arabic world regions (EGY, GLF, LEV, and MAG regions), as well as MSA. The collected corpus consists of one million (1M) tweets per Arabic variant. We did not perform any text pre-processing on the tweets, except by removing tweets that have a small length (tweets containing less than four words).
119
 
120
  ### Usage