task_categories:other annotations_creators:found language_creators:found language_creators:expert-generated multilinguality:monolingual size_categories:1K<n<10K source_datasets:extended|story_cloze language:en license:cc-by-sa-4.0 arxiv:2112.10668 region:us
XStoryCloze consists of the professionally translated version of the [English StoryCloze dataset](https://cs.rochester.edu/nlp/rocstories/) (Spring 2016 version) to 10 non-English languages. This dataset is released by Meta AI.
@article{DBLP:journals/corr/abs-2112-10668,
  author    = {Xi Victoria Lin and
               Todor Mihaylov and
               Mikel Artetxe and
               Tianlu Wang and
               Shuohui Chen and
               Daniel Simig and
               Myle Ott and
               Naman Goyal and
               Shruti Bhosale and
               Jingfei Du and
               Ramakanth Pasunuru and
               Sam Shleifer and
               Punit Singh Koura and
               Vishrav Chaudhary and
               Brian O'Horo and
               Jeff Wang and
               Luke Zettlemoyer and
               Zornitsa Kozareva and
               Mona T. Diab and
               Veselin Stoyanov and
               Xian Li},
  title     = {Few-shot Learning with Multilingual Language Models},
  journal   = {CoRR},
  volume    = {abs/2112.10668},
  year      = {2021},
  url       = {https://arxiv.org/abs/2112.10668},
  eprinttype = {arXiv},
  eprint    = {2112.10668},
  timestamp = {Tue, 04 Jan 2022 15:59:27 +0100},
  biburl    = {https://dblp.org/rec/journals/corr/abs-2112-10668.bib},
  bibsource = {dblp computer science bibliography, https://dblp.org}
}
---
annotations_creators:
- found
language:
- en
language_creators:
- found
- expert-generated
license:
- cc-by-sa-4.0
multilinguality:
- monolingual
paperswithcode_id: null
pretty_name: XStoryCloze
size_categories:
- 1K<n<10K
source_datasets:
- extended|story_cloze
tags: []
task_categories:
- other
task_ids: []
dataset_info:
- config_name: nllb-200-distilled-600M
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 492764
    num_examples: 1511
  - name: zh
    num_bytes: 500346
    num_examples: 1511
  - name: es
    num_bytes: 495103
    num_examples: 1511
  - name: ar
    num_bytes: 490629
    num_examples: 1511
  - name: hi
    num_bytes: 497109
    num_examples: 1511
  - name: id
    num_bytes: 491970
    num_examples: 1511
  - name: te
    num_bytes: 472103
    num_examples: 1511
  - name: sw
    num_bytes: 493285
    num_examples: 1511
  - name: eu
    num_bytes: 486194
    num_examples: 1511
  - name: my
    num_bytes: 545031
    num_examples: 1511
  download_size: 4619083
  dataset_size: 4964534
- config_name: nllb-200-distilled-1.3B
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 493120
    num_examples: 1511
  - name: zh
    num_bytes: 512485
    num_examples: 1511
  - name: es
    num_bytes: 494845
    num_examples: 1511
  - name: ar
    num_bytes: 488763
    num_examples: 1511
  - name: hi
    num_bytes: 495752
    num_examples: 1511
  - name: id
    num_bytes: 491866
    num_examples: 1511
  - name: te
    num_bytes: 472752
    num_examples: 1511
  - name: sw
    num_bytes: 493712
    num_examples: 1511
  - name: eu
    num_bytes: 491839
    num_examples: 1511
  - name: my
    num_bytes: 517974
    num_examples: 1511
  download_size: 4607136
  dataset_size: 4953108
- config_name: nllb-200-1.3B
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 493690
    num_examples: 1511
  - name: zh
    num_bytes: 498665
    num_examples: 1511
  - name: es
    num_bytes: 493934
    num_examples: 1511
  - name: ar
    num_bytes: 489966
    num_examples: 1511
  - name: hi
    num_bytes: 495889
    num_examples: 1511
  - name: id
    num_bytes: 492249
    num_examples: 1511
  - name: te
    num_bytes: 472101
    num_examples: 1511
  - name: sw
    num_bytes: 492297
    num_examples: 1511
  - name: eu
    num_bytes: 485674
    num_examples: 1511
  - name: my
    num_bytes: 510821
    num_examples: 1511
  download_size: 4579397
  dataset_size: 4925286
- config_name: nllb-200-3.3B
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 495392
    num_examples: 1511
  - name: zh
    num_bytes: 500965
    num_examples: 1511
  - name: es
    num_bytes: 495521
    num_examples: 1511
  - name: ar
    num_bytes: 491594
    num_examples: 1511
  - name: hi
    num_bytes: 498082
    num_examples: 1511
  - name: id
    num_bytes: 494296
    num_examples: 1511
  - name: te
    num_bytes: 477315
    num_examples: 1511
  - name: sw
    num_bytes: 496170
    num_examples: 1511
  - name: eu
    num_bytes: 499829
    num_examples: 1511
  - name: my
    num_bytes: 517806
    num_examples: 1511
  download_size: 4621130
  dataset_size: 4966970
- config_name: xglm-564M
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 541125
    num_examples: 1511
  - name: zh
    num_bytes: 825126
    num_examples: 1511
  - name: es
    num_bytes: 552675
    num_examples: 1511
  - name: ar
    num_bytes: 560267
    num_examples: 1511
  - name: hi
    num_bytes: 567030
    num_examples: 1511
  - name: id
    num_bytes: 506136
    num_examples: 1511
  - name: te
    num_bytes: 889610
    num_examples: 1511
  - name: sw
    num_bytes: 556752
    num_examples: 1511
  - name: eu
    num_bytes: 585440
    num_examples: 1511
  - name: my
    num_bytes: 1112539
    num_examples: 1511
  download_size: 6352902
  dataset_size: 6696700
- config_name: xglm-1.7B
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 490340
    num_examples: 1511
  - name: zh
    num_bytes: 486527
    num_examples: 1511
  - name: es
    num_bytes: 510488
    num_examples: 1511
  - name: ar
    num_bytes: 486931
    num_examples: 1511
  - name: hi
    num_bytes: 580025
    num_examples: 1511
  - name: id
    num_bytes: 489463
    num_examples: 1511
  - name: te
    num_bytes: 491793
    num_examples: 1511
  - name: sw
    num_bytes: 494668
    num_examples: 1511
  - name: eu
    num_bytes: 540797
    num_examples: 1511
  - name: my
    num_bytes: 531972
    num_examples: 1511
  download_size: 4757979
  dataset_size: 5103004
- config_name: xglm-2.9B
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 502967
    num_examples: 1511
  - name: zh
    num_bytes: 487153
    num_examples: 1511
  - name: es
    num_bytes: 498912
    num_examples: 1511
  - name: ar
    num_bytes: 494407
    num_examples: 1511
  - name: hi
    num_bytes: 492415
    num_examples: 1511
  - name: id
    num_bytes: 504653
    num_examples: 1511
  - name: te
    num_bytes: 500632
    num_examples: 1511
  - name: sw
    num_bytes: 496000
    num_examples: 1511
  - name: eu
    num_bytes: 488755
    num_examples: 1511
  - name: my
    num_bytes: 537296
    num_examples: 1511
  download_size: 4657865
  dataset_size: 5003190
- config_name: xglm-4.5B
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 495315
    num_examples: 1511
  - name: zh
    num_bytes: 491436
    num_examples: 1511
  - name: es
    num_bytes: 496332
    num_examples: 1511
  - name: ar
    num_bytes: 485175
    num_examples: 1511
  - name: hi
    num_bytes: 517560
    num_examples: 1511
  - name: id
    num_bytes: 491342
    num_examples: 1511
  - name: te
    num_bytes: 520378
    num_examples: 1511
  - name: sw
    num_bytes: 494811
    num_examples: 1511
  - name: eu
    num_bytes: 701365
    num_examples: 1511
  - name: my
    num_bytes: 684247
    num_examples: 1511
  download_size: 5033379
  dataset_size: 5377961
- config_name: xglm-7.5B
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 495206
    num_examples: 1511
  - name: zh
    num_bytes: 494844
    num_examples: 1511
  - name: es
    num_bytes: 496036
    num_examples: 1511
  - name: ar
    num_bytes: 486592
    num_examples: 1511
  - name: hi
    num_bytes: 492188
    num_examples: 1511
  - name: id
    num_bytes: 489364
    num_examples: 1511
  - name: te
    num_bytes: 493587
    num_examples: 1511
  - name: sw
    num_bytes: 492293
    num_examples: 1511
  - name: eu
    num_bytes: 498066
    num_examples: 1511
  - name: my
    num_bytes: 513770
    num_examples: 1511
  download_size: 4606340
  dataset_size: 4951946
- config_name: bloom-560m
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 957051
    num_examples: 1511
  - name: zh
    num_bytes: 582347
    num_examples: 1511
  - name: es
    num_bytes: 524210
    num_examples: 1511
  - name: ar
    num_bytes: 522499
    num_examples: 1511
  - name: hi
    num_bytes: 554814
    num_examples: 1511
  - name: id
    num_bytes: 485479
    num_examples: 1511
  - name: te
    num_bytes: 624860
    num_examples: 1511
  - name: sw
    num_bytes: 999225
    num_examples: 1511
  - name: eu
    num_bytes: 699035
    num_examples: 1511
  - name: my
    num_bytes: 673321
    num_examples: 1511
  download_size: 6278136
  dataset_size: 6622841
- config_name: bloom-1b1
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 698567
    num_examples: 1511
  - name: zh
    num_bytes: 489197
    num_examples: 1511
  - name: es
    num_bytes: 474082
    num_examples: 1511
  - name: ar
    num_bytes: 476907
    num_examples: 1511
  - name: hi
    num_bytes: 491779
    num_examples: 1511
  - name: id
    num_bytes: 477646
    num_examples: 1511
  - name: te
    num_bytes: 516529
    num_examples: 1511
  - name: sw
    num_bytes: 600000
    num_examples: 1511
  - name: eu
    num_bytes: 546887
    num_examples: 1511
  - name: my
    num_bytes: 676233
    num_examples: 1511
  download_size: 5102727
  dataset_size: 5447827
- config_name: bloom-1b7
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 525134
    num_examples: 1511
  - name: zh
    num_bytes: 479852
    num_examples: 1511
  - name: es
    num_bytes: 486508
    num_examples: 1511
  - name: ar
    num_bytes: 490589
    num_examples: 1511
  - name: hi
    num_bytes: 498850
    num_examples: 1511
  - name: id
    num_bytes: 485372
    num_examples: 1511
  - name: te
    num_bytes: 483735
    num_examples: 1511
  - name: sw
    num_bytes: 500094
    num_examples: 1511
  - name: eu
    num_bytes: 502181
    num_examples: 1511
  - name: my
    num_bytes: 971749
    num_examples: 1511
  download_size: 5078628
  dataset_size: 5424064
- config_name: bloom-3b
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 516891
    num_examples: 1511
  - name: zh
    num_bytes: 484312
    num_examples: 1511
  - name: es
    num_bytes: 491618
    num_examples: 1511
  - name: ar
    num_bytes: 489534
    num_examples: 1511
  - name: hi
    num_bytes: 497902
    num_examples: 1511
  - name: id
    num_bytes: 487465
    num_examples: 1511
  - name: te
    num_bytes: 492470
    num_examples: 1511
  - name: sw
    num_bytes: 492754
    num_examples: 1511
  - name: eu
    num_bytes: 499445
    num_examples: 1511
  - name: my
    num_bytes: 624041
    num_examples: 1511
  download_size: 4730785
  dataset_size: 5076432
- config_name: bloom-7b1
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 503684
    num_examples: 1511
  - name: zh
    num_bytes: 482989
    num_examples: 1511
  - name: es
    num_bytes: 491622
    num_examples: 1511
  - name: ar
    num_bytes: 482758
    num_examples: 1511
  - name: hi
    num_bytes: 489960
    num_examples: 1511
  - name: id
    num_bytes: 482001
    num_examples: 1511
  - name: te
    num_bytes: 489799
    num_examples: 1511
  - name: sw
    num_bytes: 490640
    num_examples: 1511
  - name: eu
    num_bytes: 486618
    num_examples: 1511
  - name: my
    num_bytes: 753138
    num_examples: 1511
  download_size: 4807399
  dataset_size: 5153209
- config_name: llama-7B
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 492427
    num_examples: 1511
  - name: zh
    num_bytes: 529522
    num_examples: 1511
  - name: es
    num_bytes: 498252
    num_examples: 1511
  - name: ar
    num_bytes: 512201
    num_examples: 1511
  - name: hi
    num_bytes: 511073
    num_examples: 1511
  - name: id
    num_bytes: 488707
    num_examples: 1511
  - name: te
    num_bytes: 728118
    num_examples: 1511
  - name: sw
    num_bytes: 492448
    num_examples: 1511
  - name: eu
    num_bytes: 525786
    num_examples: 1511
  - name: my
    num_bytes: 928002
    num_examples: 1511
  download_size: 5362668
  dataset_size: 5706536
- config_name: llama-13B
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 495334
    num_examples: 1511
  - name: zh
    num_bytes: 496403
    num_examples: 1511
  - name: es
    num_bytes: 502224
    num_examples: 1511
  - name: ar
    num_bytes: 495769
    num_examples: 1511
  - name: hi
    num_bytes: 494207
    num_examples: 1511
  - name: id
    num_bytes: 485652
    num_examples: 1511
  - name: te
    num_bytes: 658993
    num_examples: 1511
  - name: sw
    num_bytes: 513663
    num_examples: 1511
  - name: eu
    num_bytes: 543032
    num_examples: 1511
  - name: my
    num_bytes: 868225
    num_examples: 1511
  download_size: 5208039
  dataset_size: 5553502
- config_name: llama-30B
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 496406
    num_examples: 1511
  - name: zh
    num_bytes: 503443
    num_examples: 1511
  - name: es
    num_bytes: 502714
    num_examples: 1511
  - name: ar
    num_bytes: 499679
    num_examples: 1511
  - name: hi
    num_bytes: 506243
    num_examples: 1511
  - name: id
    num_bytes: 495591
    num_examples: 1511
  - name: te
    num_bytes: 622441
    num_examples: 1511
  - name: sw
    num_bytes: 501886
    num_examples: 1511
  - name: eu
    num_bytes: 534447
    num_examples: 1511
  - name: my
    num_bytes: 679405
    num_examples: 1511
  download_size: 4998062
  dataset_size: 5342255
- config_name: RedPajama-INCITE-Base-3B-v1
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 508585
    num_examples: 1511
  - name: zh
    num_bytes: 530992
    num_examples: 1511
  - name: es
    num_bytes: 497511
    num_examples: 1511
  - name: ar
    num_bytes: 539293
    num_examples: 1511
  - name: hi
    num_bytes: 611424
    num_examples: 1511
  - name: id
    num_bytes: 491386
    num_examples: 1511
  - name: te
    num_bytes: 721849
    num_examples: 1511
  - name: sw
    num_bytes: 565920
    num_examples: 1511
  - name: eu
    num_bytes: 610413
    num_examples: 1511
  - name: my
    num_bytes: 785689
    num_examples: 1511
  download_size: 5517969
  dataset_size: 5863062
- config_name: RedPajama-INCITE-7B-Base
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 503227
    num_examples: 1511
  - name: zh
    num_bytes: 520232
    num_examples: 1511
  - name: es
    num_bytes: 500357
    num_examples: 1511
  - name: ar
    num_bytes: 478504
    num_examples: 1511
  - name: hi
    num_bytes: 542515
    num_examples: 1511
  - name: id
    num_bytes: 486431
    num_examples: 1511
  - name: te
    num_bytes: 564067
    num_examples: 1511
  - name: sw
    num_bytes: 506463
    num_examples: 1511
  - name: eu
    num_bytes: 469138
    num_examples: 1511
  - name: my
    num_bytes: 734203
    num_examples: 1511
  download_size: 4960585
  dataset_size: 5305137
- config_name: open_llama_3b
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 505442
    num_examples: 1511
  - name: zh
    num_bytes: 532884
    num_examples: 1511
  - name: es
    num_bytes: 501815
    num_examples: 1511
  - name: ar
    num_bytes: 545831
    num_examples: 1511
  - name: hi
    num_bytes: 558097
    num_examples: 1511
  - name: id
    num_bytes: 503375
    num_examples: 1511
  - name: te
    num_bytes: 658210
    num_examples: 1511
  - name: sw
    num_bytes: 496637
    num_examples: 1511
  - name: eu
    num_bytes: 565262
    num_examples: 1511
  - name: my
    num_bytes: 102748
    num_examples: 1511
  download_size: 4629042
  dataset_size: 4970301
- config_name: open_llama_7b
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 497597
    num_examples: 1511
  - name: zh
    num_bytes: 514370
    num_examples: 1511
  - name: es
    num_bytes: 499117
    num_examples: 1511
  - name: ar
    num_bytes: 527002
    num_examples: 1511
  - name: hi
    num_bytes: 457692
    num_examples: 1511
  - name: id
    num_bytes: 486815
    num_examples: 1511
  - name: te
    num_bytes: 651761
    num_examples: 1511
  - name: sw
    num_bytes: 518217
    num_examples: 1511
  - name: eu
    num_bytes: 528817
    num_examples: 1511
  - name: my
    num_bytes: 102748
    num_examples: 1511
  download_size: 4438467
  dataset_size: 4784136
- config_name: open_llama_13b
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 497392
    num_examples: 1511
  - name: zh
    num_bytes: 506192
    num_examples: 1511
  - name: es
    num_bytes: 502102
    num_examples: 1511
  - name: ar
    num_bytes: 515020
    num_examples: 1511
  - name: hi
    num_bytes: 458156
    num_examples: 1511
  - name: id
    num_bytes: 492514
    num_examples: 1511
  - name: te
    num_bytes: 653860
    num_examples: 1511
  - name: sw
    num_bytes: 497731
    num_examples: 1511
  - name: eu
    num_bytes: 542967
    num_examples: 1511
  - name: my
    num_bytes: 102748
    num_examples: 1511
  download_size: 4423124
  dataset_size: 4768682
- config_name: falcon-7b
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 559221
    num_examples: 1511
  - name: zh
    num_bytes: 490736
    num_examples: 1511
  - name: es
    num_bytes: 496936
    num_examples: 1511
  - name: ar
    num_bytes: 555943
    num_examples: 1511
  - name: hi
    num_bytes: 760911
    num_examples: 1511
  - name: id
    num_bytes: 465017
    num_examples: 1511
  - name: te
    num_bytes: 929729
    num_examples: 1511
  - name: sw
    num_bytes: 475843
    num_examples: 1511
  - name: eu
    num_bytes: 660103
    num_examples: 1511
  - name: my
    num_bytes: 918371
    num_examples: 1511
  download_size: 5972550
  dataset_size: 6312810
- config_name: xgen-7b-4k-base
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 499102
    num_examples: 1511
  - name: zh
    num_bytes: 496212
    num_examples: 1511
  - name: es
    num_bytes: 498105
    num_examples: 1511
  - name: ar
    num_bytes: 518805
    num_examples: 1511
  - name: hi
    num_bytes: 511187
    num_examples: 1511
  - name: id
    num_bytes: 483581
    num_examples: 1511
  - name: te
    num_bytes: 564125
    num_examples: 1511
  - name: sw
    num_bytes: 539692
    num_examples: 1511
  - name: eu
    num_bytes: 526559
    num_examples: 1511
  - name: my
    num_bytes: 102748
    num_examples: 1511
  download_size: 4394369
  dataset_size: 4740116
- config_name: xgen-7b-8k-base
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 496008
    num_examples: 1511
  - name: zh
    num_bytes: 500737
    num_examples: 1511
  - name: es
    num_bytes: 496059
    num_examples: 1511
  - name: ar
    num_bytes: 492099
    num_examples: 1511
  - name: hi
    num_bytes: 522832
    num_examples: 1511
  - name: id
    num_bytes: 489283
    num_examples: 1511
  - name: te
    num_bytes: 610098
    num_examples: 1511
  - name: sw
    num_bytes: 527305
    num_examples: 1511
  - name: eu
    num_bytes: 516098
    num_examples: 1511
  - name: my
    num_bytes: 102748
    num_examples: 1511
  download_size: 4408200
  dataset_size: 4753267
- config_name: xgen-7b-8k-inst
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 497057
    num_examples: 1511
  - name: zh
    num_bytes: 519732
    num_examples: 1511
  - name: es
    num_bytes: 499680
    num_examples: 1511
  - name: ar
    num_bytes: 504726
    num_examples: 1511
  - name: hi
    num_bytes: 519968
    num_examples: 1511
  - name: id
    num_bytes: 499549
    num_examples: 1511
  - name: te
    num_bytes: 612858
    num_examples: 1511
  - name: sw
    num_bytes: 554762
    num_examples: 1511
  - name: eu
    num_bytes: 540275
    num_examples: 1511
  - name: my
    num_bytes: 102748
    num_examples: 1511
  download_size: 4507822
  dataset_size: 4851355
- config_name: open_llama_7b_v2
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 494880
    num_examples: 1511
  - name: zh
    num_bytes: 505101
    num_examples: 1511
  - name: es
    num_bytes: 498933
    num_examples: 1511
  - name: ar
    num_bytes: 480929
    num_examples: 1511
  - name: hi
    num_bytes: 526710
    num_examples: 1511
  - name: id
    num_bytes: 485906
    num_examples: 1511
  - name: te
    num_bytes: 653870
    num_examples: 1511
  - name: sw
    num_bytes: 510160
    num_examples: 1511
  - name: eu
    num_bytes: 538023
    num_examples: 1511
  - name: my
    num_bytes: 928002
    num_examples: 1511
  download_size: 5277748
  dataset_size: 5622514
- config_name: polylm-1.7b
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 501578
    num_examples: 1511
  - name: zh
    num_bytes: 492368
    num_examples: 1511
  - name: es
    num_bytes: 489279
    num_examples: 1511
  - name: ar
    num_bytes: 523803
    num_examples: 1511
  - name: hi
    num_bytes: 883583
    num_examples: 1511
  - name: id
    num_bytes: 494420
    num_examples: 1511
  - name: te
    num_bytes: 772310
    num_examples: 1511
  - name: sw
    num_bytes: 591325
    num_examples: 1511
  - name: eu
    num_bytes: 755232
    num_examples: 1511
  - name: my
    num_bytes: 928002
    num_examples: 1511
  download_size: 6086882
  dataset_size: 6431900
- config_name: polylm-13b
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 498554
    num_examples: 1511
  - name: zh
    num_bytes: 490097
    num_examples: 1511
  - name: es
    num_bytes: 497570
    num_examples: 1511
  - name: ar
    num_bytes: 497095
    num_examples: 1511
  - name: hi
    num_bytes: 682306
    num_examples: 1511
  - name: id
    num_bytes: 494517
    num_examples: 1511
  - name: te
    num_bytes: 712521
    num_examples: 1511
  - name: sw
    num_bytes: 470834
    num_examples: 1511
  - name: eu
    num_bytes: 503702
    num_examples: 1511
  - name: my
    num_bytes: 928002
    num_examples: 1511
  download_size: 5430508
  dataset_size: 5775198
- config_name: polylm-multialpaca-13b
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 496565
    num_examples: 1511
  - name: zh
    num_bytes: 494789
    num_examples: 1511
  - name: es
    num_bytes: 497108
    num_examples: 1511
  - name: ar
    num_bytes: 485852
    num_examples: 1511
  - name: hi
    num_bytes: 788707
    num_examples: 1511
  - name: id
    num_bytes: 491246
    num_examples: 1511
  - name: te
    num_bytes: 881984
    num_examples: 1511
  - name: sw
    num_bytes: 512261
    num_examples: 1511
  - name: eu
    num_bytes: 508426
    num_examples: 1511
  - name: my
    num_bytes: 928002
    num_examples: 1511
  download_size: 5739667
  dataset_size: 6084940
- config_name: open_llama_3b_v2
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 492909
    num_examples: 1511
  - name: zh
    num_bytes: 505746
    num_examples: 1511
  - name: es
    num_bytes: 499516
    num_examples: 1511
  - name: ar
    num_bytes: 498564
    num_examples: 1511
  - name: hi
    num_bytes: 573411
    num_examples: 1511
  - name: id
    num_bytes: 484221
    num_examples: 1511
  - name: te
    num_bytes: 832372
    num_examples: 1511
  - name: sw
    num_bytes: 485921
    num_examples: 1511
  - name: eu
    num_bytes: 547044
    num_examples: 1511
  - name: my
    num_bytes: 928002
    num_examples: 1511
  download_size: 5503115
  dataset_size: 5847706
- config_name: Llama-2-7b-hf
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 496817
    num_examples: 1511
  - name: zh
    num_bytes: 501800
    num_examples: 1511
  - name: es
    num_bytes: 504213
    num_examples: 1511
  - name: ar
    num_bytes: 501610
    num_examples: 1511
  - name: hi
    num_bytes: 504739
    num_examples: 1511
  - name: id
    num_bytes: 494323
    num_examples: 1511
  - name: te
    num_bytes: 588684
    num_examples: 1511
  - name: sw
    num_bytes: 501136
    num_examples: 1511
  - name: eu
    num_bytes: 520420
    num_examples: 1511
  - name: my
    num_bytes: 570585
    num_examples: 1511
  download_size: 4838759
  dataset_size: 5184327
- config_name: Llama-2-13b-hf
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 497558
    num_examples: 1511
  - name: zh
    num_bytes: 499829
    num_examples: 1511
  - name: es
    num_bytes: 500668
    num_examples: 1511
  - name: ar
    num_bytes: 502267
    num_examples: 1511
  - name: hi
    num_bytes: 499806
    num_examples: 1511
  - name: id
    num_bytes: 491094
    num_examples: 1511
  - name: te
    num_bytes: 634645
    num_examples: 1511
  - name: sw
    num_bytes: 508836
    num_examples: 1511
  - name: eu
    num_bytes: 524520
    num_examples: 1511
  - name: my
    num_bytes: 777348
    num_examples: 1511
  download_size: 5090710
  dataset_size: 5436571
- config_name: Llama-2-7b-chat-hf
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 255428
    num_examples: 1511
  - name: zh
    num_bytes: 259590
    num_examples: 1511
  - name: es
    num_bytes: 337962
    num_examples: 1511
  - name: ar
    num_bytes: 549212
    num_examples: 1511
  - name: hi
    num_bytes: 542237
    num_examples: 1511
  - name: id
    num_bytes: 445799
    num_examples: 1511
  - name: te
    num_bytes: 753517
    num_examples: 1511
  - name: sw
    num_bytes: 575797
    num_examples: 1511
  - name: eu
    num_bytes: 573902
    num_examples: 1511
  - name: my
    num_bytes: 669211
    num_examples: 1511
  download_size: 4617898
  dataset_size: 4962655
- config_name: Llama-2-13b-chat-hf
  features:
  - name: story_id
    dtype: string
  - name: input_sentence_1
    dtype: string
  - name: input_sentence_2
    dtype: string
  - name: input_sentence_3
    dtype: string
  - name: input_sentence_4
    dtype: string
  - name: sentence_quiz1
    dtype: string
  - name: sentence_quiz2
    dtype: string
  - name: answer_right_ending
    dtype: int32
  splits:
  - name: ru
    num_bytes: 513558
    num_examples: 1511
  - name: zh
    num_bytes: 524461
    num_examples: 1511
  - name: es
    num_bytes: 502511
    num_examples: 1511
  - name: ar
    num_bytes: 546387
    num_examples: 1511
  - name: hi
    num_bytes: 556189
    num_examples: 1511
  - name: id
    num_bytes: 503053
    num_examples: 1511
  - name: te
    num_bytes: 812325
    num_examples: 1511
  - name: sw
    num_bytes: 587048
    num_examples: 1511
  - name: eu
    num_bytes: 646107
    num_examples: 1511
  - name: my
    num_bytes: 804207
    num_examples: 1511
  download_size: 5650367
  dataset_size: 5995846
---

# Dataset Card for XStoryCloze MT

## Table of Contents
- [Dataset Description](#dataset-description)
  - [Dataset Summary](#dataset-summary)
  - [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)
  - [Languages](#languages)
- [Dataset Structure](#dataset-structure)
  - [Data Instances](#data-instances)
  - [Data Fields](#data-fields)
  - [Data Splits](#data-splits)
- [Dataset Creation](#dataset-creation)
  - [Curation Rationale](#curation-rationale)
  - [Source Data](#source-data)
  - [Annotations](#annotations)
  - [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
  - [Social Impact of Dataset](#social-impact-of-dataset)
  - [Discussion of Biases](#discussion-of-biases)
  - [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
  - [Dataset Curators](#dataset-curators)
  - [Licensing Information](#licensing-information)
  - [Citation Information](#citation-information)
  - [Contributions](#contributions)

## Dataset Description

- **Homepage:** [https://cs.rochester.edu/nlp/rocstories/](https://cs.rochester.edu/nlp/rocstories/)
- **Repository:** [More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)
- **Paper:** [Few-shot Learning with Multilingual Generative Language Models](https://arxiv.org/pdf/2112.10668.pdf)
- **Point of Contact:** [More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)
- **Size of downloaded dataset files:** 2.03 MB
- **Size of the generated dataset:** 2.03 MB
- **Total amount of disk used:** 2.05 MB

### Dataset Summary

XStoryCloze consists of the professionally translated version of the [English StoryCloze dataset](https://cs.rochester.edu/nlp/rocstories/) (Spring 2016 version) to 10 non-English languages. This dataset is released by Meta AI. This dataset is the machine-translated version of XstoryCloze to en from ru, zh, es, ar, hi, id, te, sw, eu, my.

### Supported Tasks and Leaderboards

commonsense reasoning

### Languages

This dataset is the machine-translated version of XstoryCloze to en from ru, zh (Simplified), es (Latin America), ar, hi, id, te, sw, eu, my.

## Dataset Structure

### Data Instances

- **Size of downloaded dataset files:** 2.03 MB
- **Size of the generated dataset:** 2.03 MB
- **Total amount of disk used:** 2.05 MB

An example of 'train' looks as follows.
```
{'answer_right_ending': 1,
 'input_sentence_1': 'Rick grew up in a troubled household.',
 'input_sentence_2': 'He never found good support in family, and turned to gangs.',
 'input_sentence_3': "It wasn't long before Rick got shot in a robbery.",
 'input_sentence_4': 'The incident caused him to turn a new leaf.',
 'sentence_quiz1': 'He is happy now.',
 'sentence_quiz2': 'He joined a gang.',
 'story_id': '138d5bfb-05cc-41e3-bf2c-fa85ebad14e2'}
```

### Data Fields

The data fields are the same among all splits.

- `input_sentence_1`: The first statement in the story.
- `input_sentence_2`: The second statement in the story.
- `input_sentence_3`: The third statement in the story.
- `input_sentence_4`: The forth statement in the story.
- `sentence_quiz1`: first possible continuation of the story. 
- `sentence_quiz2`: second possible continuation of the story. 
- `answer_right_ending`: correct possible ending; either 1 or 2. 
- `story_id`: story id. 

### Data Splits

This dataset is intended to be used for evaluating the zero- and few-shot learning capabilities of multlingual language models. We split the data for each language into train and test (360 vs. 1510 examples, respectively). The released data files for different languages maintain a line-by-line alignment.

| name  |test|
|-------|---:|
|ru|1510|
|zh|1510|
|es|1510|
|ar|1510|
|hi|1510|
|id|1510|
|te|1510|
|sw|1510|
|eu|1510|
|my|1510|

## Dataset Creation

### Curation Rationale

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Source Data

#### Initial Data Collection and Normalization

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

#### Who are the source language producers?

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Annotations

#### Annotation process

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

#### Who are the annotators?

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Personal and Sensitive Information

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

## Considerations for Using the Data

### Social Impact of Dataset

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Discussion of Biases

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Other Known Limitations

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

## Additional Information

### Dataset Curators

[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)

### Licensing Information

XStoryCloze is opensourced under [CC BY-SA 4.0](https://creativecommons.org/licenses/by-sa/4.0/legalcode), the same license as the original English StoryCloze.

### Citation Information

```
@article{DBLP:journals/corr/abs-2112-10668,
  author    = {Xi Victoria Lin and
               Todor Mihaylov and
               Mikel Artetxe and
               Tianlu Wang and
               Shuohui Chen and
               Daniel Simig and
               Myle Ott and
               Naman Goyal and
               Shruti Bhosale and
               Jingfei Du and
               Ramakanth Pasunuru and
               Sam Shleifer and
               Punit Singh Koura and
               Vishrav Chaudhary and
               Brian O'Horo and
               Jeff Wang and
               Luke Zettlemoyer and
               Zornitsa Kozareva and
               Mona T. Diab and
               Veselin Stoyanov and
               Xian Li},
  title     = {Few-shot Learning with Multilingual Language Models},
  journal   = {CoRR},
  volume    = {abs/2112.10668},
  year      = {2021},
  url       = {https://arxiv.org/abs/2112.10668},
  eprinttype = {arXiv},
  eprint    = {2112.10668},
  timestamp = {Tue, 04 Jan 2022 15:59:27 +0100},
  biburl    = {https://dblp.org/rec/journals/corr/abs-2112-10668.bib},
  bibsource = {dblp computer science bibliography, https://dblp.org}
}
```


### Contributions

Thanks to [@juletx](https://github.com/juletx).