AsirAsir commited on
Commit
93a1211
1 Parent(s): 83f6cea

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -13,8 +13,8 @@ license_link: LICENSE
13
 
14
  We are excited to announce the release of a lightweight version from the Index series models: the Index-1.9B series.
15
  The open-source Index-1.9B series includes the following models:
16
- - **Index-1.9B base (this repository's model)** : The base model, with 1.9 billion non-embedding parameters, pre-trained on a 2.8T corpus mainly in Chinese and English. It leads in multiple evaluation benchmarks compared to models of the same level.
17
- - Index-1.9B pure : A control version of the base model with the same parameters and training strategy, but strictly filtered out all instruction-related data from the corpus to verify the impact of instructions on benchmarks.
18
  - Index-1.9B chat: A dialogue model aligned with SFT and DPO based on the Index-1.9B base. We found that due to the introduction of a lot of internet community corpus in our pre-training, the model has significantly more interesting chatting capabilities.
19
  - Index-1.9B character : Introduces RAG on top of SFT and DPO to achieve few-shots role-playing customization.
20
 
 
13
 
14
  We are excited to announce the release of a lightweight version from the Index series models: the Index-1.9B series.
15
  The open-source Index-1.9B series includes the following models:
16
+ - Index-1.9B base: The base model, with 1.9 billion non-embedding parameters, pre-trained on a 2.8T corpus mainly in Chinese and English. It leads in multiple evaluation benchmarks compared to models of the same level.
17
+ - **Index-1.9B pure (this repository's model)** : A control version of the base model with the same parameters and training strategy, but strictly filtered out all instruction-related data from the corpus to verify the impact of instructions on benchmarks.
18
  - Index-1.9B chat: A dialogue model aligned with SFT and DPO based on the Index-1.9B base. We found that due to the introduction of a lot of internet community corpus in our pre-training, the model has significantly more interesting chatting capabilities.
19
  - Index-1.9B character : Introduces RAG on top of SFT and DPO to achieve few-shots role-playing customization.
20