task_categories:question-answering size_categories:1K<n<10K language:hi language:id language:su language:jv language:kn language:sw language:yo license:mit arxiv:2305.16171 region:us
---
license: mit
task_categories:
- question-answering
language:
- hi
- id
- su
- jv
- kn
- sw
- yo
size_categories:
- 1K<n<10K
---

# Dataset Card for multi-figqa

## Table of Contents
- [Dataset Description](#dataset-description)
  - [Dataset Summary](#dataset-summary)
  - [Supported Tasks](#supported-tasks-and-leaderboards)
  - [Languages](#languages)
- [Dataset Structure](#dataset-structure)
  - [Data Instances](#data-instances)
  - [Data Fields](#data-instances)
  - [Data Splits](#data-instances)
- [Dataset Creation](#dataset-creation)
  - [Curation Rationale](#curation-rationale)
  - [Source Data](#source-data)
  - [Annotations](#annotations)
  - [Personal and Sensitive Information](#personal-and-sensitive-information)
- [Considerations for Using the Data](#considerations-for-using-the-data)
  - [Social Impact of Dataset](#social-impact-of-dataset)
  - [Discussion of Biases](#discussion-of-biases)
  - [Other Known Limitations](#other-known-limitations)
- [Additional Information](#additional-information)
  - [Dataset Curators](#dataset-curators)
  - [Licensing Information](#licensing-information)
  - [Citation Information](#citation-information)

## Dataset Description

- **Homepage:** [Needs More Information]
- **Repository:** [Multi-FigQA](https://github.com/simran-khanuja/Multilingual-Fig-QA)
- **Paper:** [Multi-lingual and Multi-cultural Figurative Language Understanding
](https://arxiv.org/abs/2305.16171)
- **Leaderboard:** [Needs More Information]
- **Point of Contact:** [Emmy Liu](emmy@cmu.edu)

### Dataset Summary

A multilingual dataset of human-written creative figurative expressions in many languages (mostly metaphors and similes). The English version (with the same format) can be found [here](https://huggingface.co/datasets/nightingal3/fig-qa)

### Languages

Languages included are Hindi, Indonesian, Javanese, Kannada, Sundanese, Swahili, and Yoruba. The language codes are respectively `hi`, `id`, `kn`, `su`, `sw`, and `yo`.

## Dataset Structure

### Data Instances
```
{
    'startphrase': the phrase,
    'ending1': one possible answer,
    'ending2': another possible answer,
    'labels': 0 if ending1 is correct else 1
}
```

### Data Splits

All data in each language is originally intended to be used as a test set for that language.

## Dataset Creation

### Curation Rationale

Figurative language permeates human communication, but at the same time is relatively understudied in NLP. Datasets have been created in English to accelerate progress towards measuring and improving figurative language processing in language models (LMs). However, the use of figurative language is an expression of our cultural and societal experiences, making it difficult for these phrases to be universally applicable. We created this dataset as part of an effort to introduce more culturally relevant training data for different languages and cultures.

### Source Data


#### Who are the source language producers?

The language producers were hired to write creative sentences in their native languages.

## Additional Information


### Citation Information
Please use this citation if you found this helpful:
```
@misc{kabra2023multilingual,
      title={Multi-lingual and Multi-cultural Figurative Language Understanding}, 
      author={Anubha Kabra and Emmy Liu and Simran Khanuja and Alham Fikri Aji and Genta Indra Winata and Samuel Cahyawijaya and Anuoluwapo Aremu and Perez Ogayo and Graham Neubig},
      year={2023},
      eprint={2305.16171},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}
```