task_categories:text-classification task_categories:zero-shot-classification size_categories:10K<n<100K language:en language:tl license:cc-by-4.0 code-switching sentiment analysis low-resource languages taglish Filipino region:us
---
license: cc-by-4.0
task_categories:
- text-classification
- zero-shot-classification
language:
- en
- tl
tags:
- code-switching
- sentiment analysis
- low-resource languages
- taglish
- Filipino
size_categories:
- 10K<n<100K
---
# Dataset Card for Filipino-English Reviews with Code-Switching (FiReCS)

### Dataset Summary

We introduce FiReCS, the first sentiment-annotated corpus of product and service reviews involving Filipino-English code-switching. The data set is composed of 10,487 reviews with a fairly balanced number per sentiment class. Inter-annotator agreement is high with a Kripendorffs’s α for ordinal metric of 0.83. Three human annotators were tasked to manually label reviews according to three polarity classes: Positive, Neutral, and Negative. 

### Supported Tasks and Leaderboards

Sentiment analysis of bilingual text with code-switching / code-mixing.

### Languages

- Filipino
- English

## Dataset Structure

### Data Fields

* `review`: a string containing the body of the review
* `label`: an integer containing the label encoding of the gold-truth label provided by the human annotators

#### Label encoding
* 2 - Positive
* 1 - Neutral
* 0 - Negative

### Data Splits

| Data set split | Positive | Neutral | Negative | Total |
| -------------- | -------- | ------- | -------- | ----- |
| Train set      | 2,410    | 2,549   | 2,381    | 7,340 |
| Test set       | 1,033    | 1,087   | 1,027    | 3,147 |

### Dataset Creation and Annotation

The data set was created using publicly available online service and product reviews from Google Maps Reviews and Shopee Philippines. Only the rating and review fields were collected and stored.

Three annotators, all native speakers of Filipino and fluent in English, were tasked to manually label the data set. The first two annotators labeled the same full set of reviews. Any disagreements were sent to a third annotator.

### Personal and Sensitive Information

No personal information were collected and stored.

### Licensing Information

The FiReCS data set version 1.0 is released under the [CC-BY-4.0](https://creativecommons.org/licenses/by/4.0/) license.

### Citation Information

TBA
