Hugging Face's logo

bs-la
/
bloomz-7b1-4b-xp3ru

Feature Extraction
Transformers
PyTorch
TensorBoard
bloom
Eval Results
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
bloomz-7b1-4b-xp3ru
File size: 2,242 Bytes 
a880778
 
 
 
 
6a5cfd9
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
a880778
 
 
 
 
 
 
 
 
4703402
 
 
 
 
 
a880778
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
 
---
datasets:
- bigscience/xP3
- bs-la/xP3ru
license: bigscience-bloom-rail-1.0
model-index:
- name: bloomz-7b1
  results:
  - task:
      type: Coreference resolution
    dataset:
      type: Muennighoff/xwinograd
      name: XWinograd (ru)
      config: ru
      split: test
      revision: 9dd5ea5505fad86b7bedad667955577815300cee
    metrics:
    - type: Accuracy
      value: 53.97
  - task:
      type: Natural language inference
    dataset:
      type: xnli
      name: XNLI (ru)
      config: ru
      split: validation
      revision: a5a45e4ff92d5d3f34de70aaf4b72c3bdf9f7f16
    metrics:
    - type: Accuracy
      value: 50.00
  - task:
      type: Sentence completion
    dataset:
      type: Muennighoff/xstory_cloze
      name: XStoryCloze (ru)
      config: ru
      split: validation
      revision: 8bb76e594b68147f1a430e86829d07189622b90d
    metrics:
    - type: Accuracy
      value: 79.09
---

# Model Summary

[bloom-7b1](https://huggingface.co/bigscience/bloom-7b1) finetuned on xP3 enhanced with Russian multitask data. Hence the same as [bloomz-7b1](https://huggingface.co/bigscience/bloomz-7b1), but with additional Russian finetuning data. 4b stands for 4 billion finetuning tokens (same as bloomz-7b1).

# Citation

```
@article{yong2022bloom+,
  title={BLOOM+ 1: Adding Language Support to BLOOM for Zero-Shot Prompting},
  author={Yong, Zheng-Xin and Schoelkopf, Hailey and Muennighoff, Niklas and Aji, Alham Fikri and Adelani, David Ifeoluwa and Almubarak, Khalid and Bari, M Saiful and Sutawika, Lintang and Kasai, Jungo and Baruwa, Ahmed and others},
  journal={arXiv preprint arXiv:2212.09535},
  year={2022}
}
```

```bibtex
@misc{muennighoff2022crosslingual,
      title={Crosslingual Generalization through Multitask Finetuning}, 
      author={Niklas Muennighoff and Thomas Wang and Lintang Sutawika and Adam Roberts and Stella Biderman and Teven Le Scao and M Saiful Bari and Sheng Shen and Zheng-Xin Yong and Hailey Schoelkopf and Xiangru Tang and Dragomir Radev and Alham Fikri Aji and Khalid Almubarak and Samuel Albanie and Zaid Alyafeai and Albert Webson and Edward Raff and Colin Raffel},
      year={2022},
      eprint={2211.01786},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}
```