AUB MIND LAB
commited on
Commit
•
f0eaaad
1
Parent(s):
9b4fcd2
Update README.md
Browse files
README.md
CHANGED
|
@@ -80,12 +80,13 @@ It is recommended to apply our preprocessing function before training/testing on
|
|
| 80 |
**Install farasapy to segment text for AraBERT v1 & v2 `pip install farasapy`**
|
| 81 |
|
| 82 |
```python
|
| 83 |
-
from arabert.preprocess import
|
|
|
|
|
|
|
|
|
|
| 84 |
|
| 85 |
text = "ولن نبالغ إذا قلنا إن هاتف أو كمبيوتر المكتب في زمننا هذا ضروري"
|
| 86 |
-
preprocess(text
|
| 87 |
-
model_name="bert-large-arabertv02",
|
| 88 |
-
keep_emojis=False)
|
| 89 |
```
|
| 90 |
|
| 91 |
## Accepted_models
|
|
|
|
| 80 |
**Install farasapy to segment text for AraBERT v1 & v2 `pip install farasapy`**
|
| 81 |
|
| 82 |
```python
|
| 83 |
+
from arabert.preprocess import ArabertPreprocessor
|
| 84 |
+
|
| 85 |
+
model_name="bert-large-arabertv02"
|
| 86 |
+
arabert_prep = ArabertPreprocessor(model_name=model_name)
|
| 87 |
|
| 88 |
text = "ولن نبالغ إذا قلنا إن هاتف أو كمبيوتر المكتب في زمننا هذا ضروري"
|
| 89 |
+
arabert_prep.preprocess(text)
|
|
|
|
|
|
|
| 90 |
```
|
| 91 |
|
| 92 |
## Accepted_models
|