task_categories:summarization size_categories:100K<n<1M language:th license:cc-by-4.0 region:us
---
dataset_info:
  features:
  - name: document
    dtype: string
  - name: summary
    dtype: string
  - name: id
    dtype: string
  splits:
  - name: train
    num_bytes: 564265828
    num_examples: 204045
  - name: validation
    num_bytes: 31430109
    num_examples: 11332
  - name: test
    num_bytes: 31586845
    num_examples: 11334
  download_size: 249951073
  dataset_size: 627282782
license: cc-by-4.0
task_categories:
- summarization
language:
- th
size_categories:
- 100K<n<1M
---

# Dataset Card for "xsum_thai 🇹🇭"

- This dataset is based on [XSum](https://huggingface.co/datasets/xsum).
- The documents and summaries were translated from English (as in the original XSum) to Thai using Meta's [NLLB-200-3.3B](https://huggingface.co/facebook/nllb-200-3.3B). 
  - hyperparameters: max_length=(doc=1024, sum=512), num_beams=4, no_repeat_ngram_size=6, repetition_penalty=1.2
- GitHub repo: https://github.com/potsawee/thaisum_data
- The dataset is intended for Thai Summarization, e.g., ThaiNews -> ThaiSummary.
- This dataset can be cross-linked with the original (English) XSum using the `id` attribute
- Note that we observe the input length is noticably shorter than the original English version (stats to be included)

### Data Fields

- `id`: BBC ID of the article.
- `document`: a string containing the *translated* body of the news article 
- `summary`: a string containing the *translated* summary of the article.

## Data Structure

```
{
    "id": "29750031",
    "document": "news article in Thai",
    "summary": "summary in Thai"
}
```

### Data Splits
train/validation/test = 204045/11332/11334