t push
Browse filesMerge branch 'main' of https://huggingface.co/Muennighoff/bloomz-7b1-4b-ru
README.md
ADDED
|
@@ -0,0 +1,62 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
datasets:
|
| 3 |
+
- bs-la/xP3ru
|
| 4 |
+
license: bigscience-bloom-rail-1.0
|
| 5 |
+
model-index:
|
| 6 |
+
- name: bloomz-7b1
|
| 7 |
+
results:
|
| 8 |
+
- task:
|
| 9 |
+
type: Coreference resolution
|
| 10 |
+
dataset:
|
| 11 |
+
type: Muennighoff/xwinograd
|
| 12 |
+
name: XWinograd (ru)
|
| 13 |
+
config: ru
|
| 14 |
+
split: test
|
| 15 |
+
revision: 9dd5ea5505fad86b7bedad667955577815300cee
|
| 16 |
+
metrics:
|
| 17 |
+
- type: Accuracy
|
| 18 |
+
value: 53.97
|
| 19 |
+
- task:
|
| 20 |
+
type: Natural language inference
|
| 21 |
+
dataset:
|
| 22 |
+
type: xnli
|
| 23 |
+
name: XNLI (ru)
|
| 24 |
+
config: ru
|
| 25 |
+
split: validation
|
| 26 |
+
revision: a5a45e4ff92d5d3f34de70aaf4b72c3bdf9f7f16
|
| 27 |
+
metrics:
|
| 28 |
+
- type: Accuracy
|
| 29 |
+
value: 33.49
|
| 30 |
+
- task:
|
| 31 |
+
type: Sentence completion
|
| 32 |
+
dataset:
|
| 33 |
+
type: Muennighoff/xstory_cloze
|
| 34 |
+
name: XStoryCloze (ru)
|
| 35 |
+
config: ru
|
| 36 |
+
split: validation
|
| 37 |
+
revision: 8bb76e594b68147f1a430e86829d07189622b90d
|
| 38 |
+
metrics:
|
| 39 |
+
- type: Accuracy
|
| 40 |
+
value: 48.64
|
| 41 |
+
---
|
| 42 |
+
|
| 43 |
+
# Model Summary
|
| 44 |
+
|
| 45 |
+
[bloom-7b1](https://huggingface.co/bigscience/bloom-7b1) finetuned on Russian multitask data. Hence the same as [bloomz-7b1](https://huggingface.co/bigscience/bloomz-7b1), but with **only** Russian finetuning data. 4b stands for 4 billion finetuning tokens (same as bloomz-7b1).
|
| 46 |
+
|
| 47 |
+
# Citation
|
| 48 |
+
|
| 49 |
+
```
|
| 50 |
+
BLOOM+1 - TODO
|
| 51 |
+
```
|
| 52 |
+
|
| 53 |
+
```bibtex
|
| 54 |
+
@misc{muennighoff2022crosslingual,
|
| 55 |
+
title={Crosslingual Generalization through Multitask Finetuning},
|
| 56 |
+
author={Niklas Muennighoff and Thomas Wang and Lintang Sutawika and Adam Roberts and Stella Biderman and Teven Le Scao and M Saiful Bari and Sheng Shen and Zheng-Xin Yong and Hailey Schoelkopf and Xiangru Tang and Dragomir Radev and Alham Fikri Aji and Khalid Almubarak and Samuel Albanie and Zaid Alyafeai and Albert Webson and Edward Raff and Colin Raffel},
|
| 57 |
+
year={2022},
|
| 58 |
+
eprint={2211.01786},
|
| 59 |
+
archivePrefix={arXiv},
|
| 60 |
+
primaryClass={cs.CL}
|
| 61 |
+
}
|
| 62 |
+
```
|