|
--- |
|
language: |
|
- en |
|
tags: |
|
- summarization |
|
license: mit |
|
datasets: |
|
- wiki_lingua |
|
metrics: |
|
- rouge |
|
--- |
|
|
|
#### Pre-trained BART Model fine-tune on WikiLingua dataset |
|
The repository for the fine-tuned BART model (by sshleifer) using the **wiki_lingua** dataset (English) |
|
|
|
**Purpose:** Examine the performance of a fine-tuned model research purposes |
|
|
|
**Observation:** |
|
- Pre-trained model was trained on the XSum dataset, which summarize a not-too-long documents into one-liner summary |
|
- Fine-tuning this model using WikiLingua is appropriate since the summaries for that dataset are also short |
|
- In the end, however, the model cannot capture much clearer key points, but instead it mostly extracts the opening sentence |
|
- Some data pre-processing and models' hyperparameter are also need to be tuned more properly. |
