Update README.md
Browse files
README.md
CHANGED
@@ -1,37 +1,4 @@
|
|
1 |
---
|
2 |
-
base_model: []
|
3 |
library_name: transformers
|
4 |
-
tags:
|
5 |
-
- mergekit
|
6 |
-
- merge
|
7 |
-
|
8 |
---
|
9 |
-
|
10 |
-
|
11 |
-
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
12 |
-
|
13 |
-
## Merge Details
|
14 |
-
### Merge Method
|
15 |
-
|
16 |
-
This model was merged using the passthrough merge method.
|
17 |
-
|
18 |
-
### Models Merged
|
19 |
-
|
20 |
-
The following models were included in the merge:
|
21 |
-
* /mnt/beegfs/fahad.khan/Arabic_MobiLlama/mergekit/outputs/cohere_acegpt
|
22 |
-
|
23 |
-
### Configuration
|
24 |
-
|
25 |
-
The following YAML configuration was used to produce this model:
|
26 |
-
|
27 |
-
```yaml
|
28 |
-
slices:
|
29 |
-
- sources:
|
30 |
-
- layer_range: [0,39]
|
31 |
-
model: /mnt/beegfs/fahad.khan/Arabic_MobiLlama/mergekit/outputs/cohere_acegpt
|
32 |
-
- sources:
|
33 |
-
- layer_range: [51,60]
|
34 |
-
model: /mnt/beegfs/fahad.khan/Arabic_MobiLlama/mergekit/outputs/cohere_acegpt
|
35 |
-
merge_method: passthrough
|
36 |
-
dtype: float16
|
37 |
-
```
|
|
|
1 |
---
|
|
|
2 |
library_name: transformers
|
|
|
|
|
|
|
|
|
3 |
---
|
4 |
+
This is the Arabic test model built at MBZUAI. More details of the projects will be announced later along with the release. This model card is just to test the capabilities of this model on Arabic benchmarks.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|