task_categories:token-classification size_categories:10K<n<100K language:ar language:de language:en language:es language:it language:fr language:zh license:cc-by-sa-4.0 arxiv:2306.09802 region:us
Relation Extraction (RE) is a task that identifies relationships between entities in a text, enabling the acquisition of relational facts and bridging the gap between natural language and structured knowledge. However, current RE models often rely on small datasets with low coverage of relation types, particularly when working with languages other than English. \In this paper, we address the above issue and provide two new resources that enable the training and evaluation of multilingual RE systems.
First, we present SRED\textsuperscript{FM}, an automatically annotated dataset covering 18 languages, 400 relation types, 13 entity types, totaling more than 40 million triplet instances. Second, we propose RED\textsuperscript{FM}, a smaller, human-revised dataset for seven languages that allows for the evaluation of multilingual RE systems. 
To demonstrate the utility of these novel datasets, we experiment with the first end-to-end multilingual RE model, mREBEL, 
that extracts triplets, including entity types, in multiple languages. We release our resources and model checkpoints at \href{https://www.github.com/babelscape/rebel}{https://www.github.com/babelscape/rebel}.
@InProceedings{redfm2023,
  author = {Huguet Cabot, Pere-Lluis
                 and Tedeschi, Simone
                 and Ngonga Ngomo, Axel-Cyrille
                 and Navigli, Roberto},
  title = {RED\textsuperscript{FM}: a Filtered and Multilingual Relation Extraction Dataset},
  booktitle = {Proceedings of the 2023 Conference on Association for Computational Linguistics},
  year = {2023},
  publisher = {Association for Computational Linguistics},
  location = {Toronto, Canada},
}
---
dataset_info:
- config_name: ar
  features:
  - name: docid
    dtype: string
  - name: title
    dtype: string
  - name: uri
    dtype: string
  - name: text
    dtype: string
  - name: entities
    list:
    - name: uri
      dtype: string
    - name: surfaceform
      dtype: string
    - name: type
      dtype: string
    - name: start
      dtype: int32
    - name: end
      dtype: int32
  - name: relations
    list:
    - name: subject
      struct:
      - name: uri
        dtype: string
      - name: surfaceform
        dtype: string
      - name: type
        dtype: string
      - name: start
        dtype: int32
      - name: end
        dtype: int32
    - name: predicate
      dtype:
        class_label:
          names:
            '0': country
            '1': place of birth
            '2': spouse
            '3': country of citizenship
            '4': instance of
            '5': capital
            '6': child
            '7': shares border with
            '8': author
            '9': director
            '10': occupation
            '11': founded by
            '12': league
            '13': owned by
            '14': genre
            '15': named after
            '16': follows
            '17': headquarters location
            '18': cast member
            '19': manufacturer
            '20': located in or next to body of water
            '21': location
            '22': part of
            '23': mouth of the watercourse
            '24': member of
            '25': sport
            '26': characters
            '27': participant
            '28': notable work
            '29': replaces
            '30': sibling
            '31': inception
    - name: object
      struct:
      - name: uri
        dtype: string
      - name: surfaceform
        dtype: string
      - name: type
        dtype: string
      - name: start
        dtype: int32
      - name: end
        dtype: int32
  splits:
  - name: test
    num_bytes: 521806
    num_examples: 345
  - name: validation
    num_bytes: 577499
    num_examples: 385
  download_size: 3458539
  dataset_size: 1099305
- config_name: de
  features:
  - name: docid
    dtype: string
  - name: title
    dtype: string
  - name: uri
    dtype: string
  - name: text
    dtype: string
  - name: entities
    list:
    - name: uri
      dtype: string
    - name: surfaceform
      dtype: string
    - name: type
      dtype: string
    - name: start
      dtype: int32
    - name: end
      dtype: int32
  - name: relations
    list:
    - name: subject
      struct:
      - name: uri
        dtype: string
      - name: surfaceform
        dtype: string
      - name: type
        dtype: string
      - name: start
        dtype: int32
      - name: end
        dtype: int32
    - name: predicate
      dtype:
        class_label:
          names:
            '0': country
            '1': place of birth
            '2': spouse
            '3': country of citizenship
            '4': instance of
            '5': capital
            '6': child
            '7': shares border with
            '8': author
            '9': director
            '10': occupation
            '11': founded by
            '12': league
            '13': owned by
            '14': genre
            '15': named after
            '16': follows
            '17': headquarters location
            '18': cast member
            '19': manufacturer
            '20': located in or next to body of water
            '21': location
            '22': part of
            '23': mouth of the watercourse
            '24': member of
            '25': sport
            '26': characters
            '27': participant
            '28': notable work
            '29': replaces
            '30': sibling
            '31': inception
    - name: object
      struct:
      - name: uri
        dtype: string
      - name: surfaceform
        dtype: string
      - name: type
        dtype: string
      - name: start
        dtype: int32
      - name: end
        dtype: int32
  splits:
  - name: train
    num_bytes: 2455615
    num_examples: 2071
  - name: test
    num_bytes: 334212
    num_examples: 285
  - name: validation
    num_bytes: 310862
    num_examples: 252
  download_size: 8072481
  dataset_size: 3100689
- config_name: en
  features:
  - name: docid
    dtype: string
  - name: title
    dtype: string
  - name: uri
    dtype: string
  - name: text
    dtype: string
  - name: entities
    list:
    - name: uri
      dtype: string
    - name: surfaceform
      dtype: string
    - name: type
      dtype: string
    - name: start
      dtype: int32
    - name: end
      dtype: int32
  - name: relations
    list:
    - name: subject
      struct:
      - name: uri
        dtype: string
      - name: surfaceform
        dtype: string
      - name: type
        dtype: string
      - name: start
        dtype: int32
      - name: end
        dtype: int32
    - name: predicate
      dtype:
        class_label:
          names:
            '0': country
            '1': place of birth
            '2': spouse
            '3': country of citizenship
            '4': instance of
            '5': capital
            '6': child
            '7': shares border with
            '8': author
            '9': director
            '10': occupation
            '11': founded by
            '12': league
            '13': owned by
            '14': genre
            '15': named after
            '16': follows
            '17': headquarters location
            '18': cast member
            '19': manufacturer
            '20': located in or next to body of water
            '21': location
            '22': part of
            '23': mouth of the watercourse
            '24': member of
            '25': sport
            '26': characters
            '27': participant
            '28': notable work
            '29': replaces
            '30': sibling
            '31': inception
    - name: object
      struct:
      - name: uri
        dtype: string
      - name: surfaceform
        dtype: string
      - name: type
        dtype: string
      - name: start
        dtype: int32
      - name: end
        dtype: int32
  splits:
  - name: train
    num_bytes: 4387657
    num_examples: 2878
  - name: test
    num_bytes: 654376
    num_examples: 446
  - name: validation
    num_bytes: 617141
    num_examples: 449
  download_size: 13616716
  dataset_size: 5659174
- config_name: es
  features:
  - name: docid
    dtype: string
  - name: title
    dtype: string
  - name: uri
    dtype: string
  - name: text
    dtype: string
  - name: entities
    list:
    - name: uri
      dtype: string
    - name: surfaceform
      dtype: string
    - name: type
      dtype: string
    - name: start
      dtype: int32
    - name: end
      dtype: int32
  - name: relations
    list:
    - name: subject
      struct:
      - name: uri
        dtype: string
      - name: surfaceform
        dtype: string
      - name: type
        dtype: string
      - name: start
        dtype: int32
      - name: end
        dtype: int32
    - name: predicate
      dtype:
        class_label:
          names:
            '0': country
            '1': place of birth
            '2': spouse
            '3': country of citizenship
            '4': instance of
            '5': capital
            '6': child
            '7': shares border with
            '8': author
            '9': director
            '10': occupation
            '11': founded by
            '12': league
            '13': owned by
            '14': genre
            '15': named after
            '16': follows
            '17': headquarters location
            '18': cast member
            '19': manufacturer
            '20': located in or next to body of water
            '21': location
            '22': part of
            '23': mouth of the watercourse
            '24': member of
            '25': sport
            '26': characters
            '27': participant
            '28': notable work
            '29': replaces
            '30': sibling
            '31': inception
    - name: object
      struct:
      - name: uri
        dtype: string
      - name: surfaceform
        dtype: string
      - name: type
        dtype: string
      - name: start
        dtype: int32
      - name: end
        dtype: int32
  splits:
  - name: train
    num_bytes: 2452744
    num_examples: 1866
  - name: test
    num_bytes: 345782
    num_examples: 281
  - name: validation
    num_bytes: 299692
    num_examples: 228
  download_size: 7825400
  dataset_size: 3098218
- config_name: fr
  features:
  - name: docid
    dtype: string
  - name: title
    dtype: string
  - name: uri
    dtype: string
  - name: text
    dtype: string
  - name: entities
    list:
    - name: uri
      dtype: string
    - name: surfaceform
      dtype: string
    - name: type
      dtype: string
    - name: start
      dtype: int32
    - name: end
      dtype: int32
  - name: relations
    list:
    - name: subject
      struct:
      - name: uri
        dtype: string
      - name: surfaceform
        dtype: string
      - name: type
        dtype: string
      - name: start
        dtype: int32
      - name: end
        dtype: int32
    - name: predicate
      dtype:
        class_label:
          names:
            '0': country
            '1': place of birth
            '2': spouse
            '3': country of citizenship
            '4': instance of
            '5': capital
            '6': child
            '7': shares border with
            '8': author
            '9': director
            '10': occupation
            '11': founded by
            '12': league
            '13': owned by
            '14': genre
            '15': named after
            '16': follows
            '17': headquarters location
            '18': cast member
            '19': manufacturer
            '20': located in or next to body of water
            '21': location
            '22': part of
            '23': mouth of the watercourse
            '24': member of
            '25': sport
            '26': characters
            '27': participant
            '28': notable work
            '29': replaces
            '30': sibling
            '31': inception
    - name: object
      struct:
      - name: uri
        dtype: string
      - name: surfaceform
        dtype: string
      - name: type
        dtype: string
      - name: start
        dtype: int32
      - name: end
        dtype: int32
  splits:
  - name: train
    num_bytes: 2280992
    num_examples: 1865
  - name: test
    num_bytes: 427990
    num_examples: 415
  - name: validation
    num_bytes: 429165
    num_examples: 416
  download_size: 8257363
  dataset_size: 3138147
- config_name: it
  features:
  - name: docid
    dtype: string
  - name: title
    dtype: string
  - name: uri
    dtype: string
  - name: text
    dtype: string
  - name: entities
    list:
    - name: uri
      dtype: string
    - name: surfaceform
      dtype: string
    - name: type
      dtype: string
    - name: start
      dtype: int32
    - name: end
      dtype: int32
  - name: relations
    list:
    - name: subject
      struct:
      - name: uri
        dtype: string
      - name: surfaceform
        dtype: string
      - name: type
        dtype: string
      - name: start
        dtype: int32
      - name: end
        dtype: int32
    - name: predicate
      dtype:
        class_label:
          names:
            '0': country
            '1': place of birth
            '2': spouse
            '3': country of citizenship
            '4': instance of
            '5': capital
            '6': child
            '7': shares border with
            '8': author
            '9': director
            '10': occupation
            '11': founded by
            '12': league
            '13': owned by
            '14': genre
            '15': named after
            '16': follows
            '17': headquarters location
            '18': cast member
            '19': manufacturer
            '20': located in or next to body of water
            '21': location
            '22': part of
            '23': mouth of the watercourse
            '24': member of
            '25': sport
            '26': characters
            '27': participant
            '28': notable work
            '29': replaces
            '30': sibling
            '31': inception
    - name: object
      struct:
      - name: uri
        dtype: string
      - name: surfaceform
        dtype: string
      - name: type
        dtype: string
      - name: start
        dtype: int32
      - name: end
        dtype: int32
  splits:
  - name: train
    num_bytes: 1918310
    num_examples: 1657
  - name: test
    num_bytes: 489445
    num_examples: 509
  - name: validation
    num_bytes: 485557
    num_examples: 521
  download_size: 7537265
  dataset_size: 2893312
- config_name: zh
  features:
  - name: docid
    dtype: string
  - name: title
    dtype: string
  - name: uri
    dtype: string
  - name: text
    dtype: string
  - name: entities
    list:
    - name: uri
      dtype: string
    - name: surfaceform
      dtype: string
    - name: type
      dtype: string
    - name: start
      dtype: int32
    - name: end
      dtype: int32
  - name: relations
    list:
    - name: subject
      struct:
      - name: uri
        dtype: string
      - name: surfaceform
        dtype: string
      - name: type
        dtype: string
      - name: start
        dtype: int32
      - name: end
        dtype: int32
    - name: predicate
      dtype:
        class_label:
          names:
            '0': country
            '1': place of birth
            '2': spouse
            '3': country of citizenship
            '4': instance of
            '5': capital
            '6': child
            '7': shares border with
            '8': author
            '9': director
            '10': occupation
            '11': founded by
            '12': league
            '13': owned by
            '14': genre
            '15': named after
            '16': follows
            '17': headquarters location
            '18': cast member
            '19': manufacturer
            '20': located in or next to body of water
            '21': location
            '22': part of
            '23': mouth of the watercourse
            '24': member of
            '25': sport
            '26': characters
            '27': participant
            '28': notable work
            '29': replaces
            '30': sibling
            '31': inception
    - name: object
      struct:
      - name: uri
        dtype: string
      - name: surfaceform
        dtype: string
      - name: type
        dtype: string
      - name: start
        dtype: int32
      - name: end
        dtype: int32
  splits:
  - name: test
    num_bytes: 311905
    num_examples: 270
  - name: validation
    num_bytes: 364077
    num_examples: 307
  download_size: 1952982
  dataset_size: 675982
- config_name: all_languages
  features:
  - name: docid
    dtype: string
  - name: title
    dtype: string
  - name: uri
    dtype: string
  - name: lan
    dtype: string
  - name: text
    dtype: string
  - name: entities
    list:
    - name: uri
      dtype: string
    - name: surfaceform
      dtype: string
    - name: type
      dtype: string
    - name: start
      dtype: int32
    - name: end
      dtype: int32
  - name: relations
    list:
    - name: subject
      struct:
      - name: uri
        dtype: string
      - name: surfaceform
        dtype: string
      - name: type
        dtype: string
      - name: start
        dtype: int32
      - name: end
        dtype: int32
    - name: predicate
      dtype:
        class_label:
          names:
            '0': country
            '1': place of birth
            '2': spouse
            '3': country of citizenship
            '4': instance of
            '5': capital
            '6': child
            '7': shares border with
            '8': author
            '9': director
            '10': occupation
            '11': founded by
            '12': league
            '13': owned by
            '14': genre
            '15': named after
            '16': follows
            '17': headquarters location
            '18': cast member
            '19': manufacturer
            '20': located in or next to body of water
            '21': location
            '22': part of
            '23': mouth of the watercourse
            '24': member of
            '25': sport
            '26': characters
            '27': participant
            '28': notable work
            '29': replaces
            '30': sibling
            '31': inception
    - name: object
      struct:
      - name: uri
        dtype: string
      - name: surfaceform
        dtype: string
      - name: type
        dtype: string
      - name: start
        dtype: int32
      - name: end
        dtype: int32
  splits:
  - name: train
    num_bytes: 13557340
    num_examples: 10337
  - name: test
    num_bytes: 3100822
    num_examples: 2551
  - name: validation
    num_bytes: 3099341
    num_examples: 2558
  download_size: 50720746
  dataset_size: 19757503
task_categories:
- token-classification
language:
- ar
- de
- en
- es
- it
- fr
- zh
size_categories:
- 10K<n<100K
license: cc-by-sa-4.0
---
# RED<sup>FM</sup>: a Filtered and Multilingual Relation Extraction Dataset

This is the human-filtered dataset from the 2023 ACL paper [RED^{FM}: a Filtered and Multilingual Relation Extraction Dataset](https://arxiv.org/abs/2306.09802). If you use the model, please reference this work in your paper:

    @inproceedings{huguet-cabot-et-al-2023-redfm-dataset,
        title = "RED$^{\rm FM}$: a Filtered and Multilingual Relation Extraction Dataset",
        author = "Huguet Cabot, Pere-Llu{\'\i}s  and Tedeschi, Simone and Ngonga Ngomo, Axel-Cyrille and
          Navigli, Roberto",
        booktitle = "Proc. of the 61st Annual Meeting of the Association for Computational Linguistics: ACL 2023",
        month = jul,
        year = "2023",
        address = "Toronto, Canada",
        publisher = "Association for Computational Linguistics",
        url = "https://arxiv.org/abs/2306.09802",
    }


## License

RED<sup>FM</sup> is licensed under the CC BY-SA 4.0 license. The text of the license can be found [here](https://creativecommons.org/licenses/by-sa/4.0/).