task_categories:text-classification task_categories:zero-shot-classification task_categories:text-generation task_categories:token-classification task_categories:feature-extraction task_categories:text2text-generation size_categories:1K<n<10K language:en license:mit music art arxiv:2309.13259 region:us
We plan to publish WikiMT++ onto TISMIR...
@dataset{Zhou2023WikiMTPlus,
  title     = {WikiMT++ Dataset Card},
  author    = {Monan Zhou, Shangda Wu, Yuan Wang, Wei Li},
  journal   = {ArXiv},
  month     = {Sep},
  year      = {2023},
  publisher = {HuggingFace},
  version   = {2.2},
  volume    = {abs/2309.13259},
  url       = {https://arxiv.org/abs/2309.13259}
}
---
license: mit
task_categories:
- text-classification
- zero-shot-classification
- text-generation
- token-classification
- feature-extraction
- text2text-generation
language:
- en
tags:
- music
- art
pretty_name: WikiMT++
size_categories:
- 1K<n<10K
---

# Dataset Card for WikiMT++
## Dataset Description
- **Homepage:** [CCOM/wikimt_plus](https://huggingface.co/datasets/CCOM/wikimt_plus)
- **Repository:** `git@hf.co:datasets/CCOM/wikimt_plus`
- **Paper:** [WikiMT++ Dataset Card](https://arxiv.org/pdf/2309.13259.pdf)
- **Leaderboard:** [arxiv:2309.13259](https://arxiv.org/abs/2309.13259)
- **Point of Contact:** This dataset has not been officially released yet and is still undergoing validation and evaluation. The data publicly available during the validation process is solely intended for verification and cannot be used for other purposes.

## Dataset Summary
WikiMT++ is an expanded and refined version of WikiMusicText (WikiMT), featuring 1010 curated lead sheets in ABC notation. To expand application scenarios of WikiMT, we add both objective (album, lyrics, video) and subjective emotion (12 emotion adjectives) and emo\_4q (Russell 4Q) attributes, enhancing its usability for music information retrieval, conditional music generation, automatic composition, and emotion classification, etc. Additionally, CLaMP is implemented to correct the attributes inherited from WikiMT to reduce errors introduced during original data collection and enhance the accuracy and completeness of our dataset.

## Supported Tasks and Leaderboards
Audio classification, music generation, MIR, etc

## Languages
Multilingual

## Usage
```
from datasets import load_dataset

dataset = load_dataset("CCOM/wikimt_plus")

for item in dataset['train']:
    print(item['midi_score'])
```

## Requirements
librosa, soundfile

## Dataset Structure
### Data Instances
.json, .zip(.jpg, .mid, .mp3, .musicxml, .mxl, .pdf)

### Data Fields
audio music, text, video url, symbolic music, image, etc

### Data Splits
Train, validation, test

## Dataset Creation
### Curation Rationale
Promoting the development of AI in the music industry

### Source Data
#### Initial Data Collection and Normalization
Monan Zhou, Shangda Wu, Yuan Wang, et al.

#### Who are the source language producers?
Composers of the songs in dataset

### Annotations
#### Annotation process
1. Use mturk and scripts to verify wikimt v2 into v2.2
2. Annotators fix wikimt v2.2 to v2.3

#### Who are the annotators?
Annotators from mturk, CCOM and Fudan University

### Personal and Sensitive Information
None

## Considerations for Using the Data
### Social Impact of Dataset
Promoting the development of AI in the music industry

### Discussion of Biases
Most are English songs

### Other Known Limitations
Samples are not balanced enough

## Additional Information
### Dataset Curators
Monan Zhou

### Licensing Information
```
MIT License

Copyright (c) CCOM

Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all
copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
SOFTWARE.
```

### Citation Information
```
@article{DBLP:journals/corr/abs-2309-13259,
  author       = {Monan Zhou and
                  Shangda Wu and
                  Yuan Wang and
                  Wei Li},
  title        = {WikiMT++ Dataset Card},
  journal      = {CoRR},
  volume       = {abs/2309.13259},
  year         = {2023},
  url          = {https://doi.org/10.48550/arXiv.2309.13259},
  doi          = {10.48550/arXiv.2309.13259},
  eprinttype    = {arXiv},
  eprint       = {2309.13259},
  timestamp    = {Wed, 27 Sep 2023 11:44:46 +0200},
  biburl       = {https://dblp.org/rec/journals/corr/abs-2309-13259.bib},
  bibsource    = {dblp computer science bibliography, https://dblp.org}
}
```

### Contributions
Provide a dataset for music classification, generation, etc