task_categories:automatic-speech-recognition size_categories:1K<n<10K language:ml license:cc-by-4.0 region:us
---
license: cc-by-4.0
task_categories:
- automatic-speech-recognition
language:
- ml
pretty_name: SMC Malayalam Speech Corpus(MSC)
size_categories:
- 1K<n<10K
---

# Dataset Card for SMC Malayalam Speech Corpus(MSC)

## Dataset Description


- **Homepage: [MSC app](https://msc.smc.org.in/)** 
- **Repository:(https://gitlab.com/smc/msc/-/tree/master/audio)** 
- **Paper:[Release Blog Post](https://blog.smc.org.in/malayalam-speech-corpus/)**
- **Point of Contact: [Kavya Manohar(https://huggingface.co/kavyamanohar)]** 

### Dataset Summary

This is the repository of a curated subset of speech samples collected using [MSC app](https://msc.smc.org.in/). Speech samples are selected on the criteria that they have at least 3 positive reviews. The original corpus of collected audios is available [here](https://gitlab.com/smc/msc/-/tree/master/audio). The latest version of curated Malayalam Speech Corpus is hosted [here](https://releases.smc.org.in/msc-reviewed-speech/).

### Supported Tasks and Leaderboards

Automatic Speech Recognition

### Languages

Malayalam

## Dataset Structure

Speech files are single channel audio in raw audio format sampled at 48 kHz and encoded with 16 bits per sample. Metadata is published as a list of tab separated values with the following details corresponding to every speech file. It contains an alphanumeric speech id, path of speech file, alphanumeric speaker id, review score, transcript in Malayalam script,  Sentence category: proverb, conversation, story or none (indicated by default), Speaker gender: optionally given by user as female, male or other and no response (indicated with default),  Speaker age: optionally given by user and no response (indicated with default).  

### Data Instances

*1541 speech samples. It corresponds to a duration of 1:38:16 hours.*

### Data Fields

It contains an alphanumeric speech id, path of speech file, alphanumeric speaker id, review score, transcript in Malayalam script,  Sentence category: proverb, conversation, story or none (indicated by default), Speaker gender: optionally given by user as female, male or other and no response (indicated with default),  Speaker age: optionally given by user and no response (indicated with default).  

### Data Splits

No specific Split

## Dataset Creation

The data set is created with the aim of providing accessible open speech data set for the research and development of speech technologies for Malayalam, especially ASR.


### Curation Rationale

This is a subset of speech samples collected and reviewed in [MSC app](https://msc.smc.org.in). Those speech samples which has received atleast three positive review scores are published here. The complete set in webm format is available [here](https://gitlab.com/smc/msc)

### Source Data

#### Initial Data Collection and Normalization

This project is entirely built on volunteer efforts from various language technology enthusiasts. The speech data collection and review are crowd-sourced. We believe the review process should have helped to curate the speech as noiseless as possible.


### Personal and Sensitive Information

The speaker information (gender and age) are available if voice contributors have voluntarily published it.

## Considerations for Using the Data

### Social Impact of Dataset

[More Information Needed]

### Discussion of Biases

[More Information Needed]

### Other Known Limitations

[More Information Needed]

## Additional Information

### Dataset Curators

[More Information Needed]

### Licensing Information

[More Information Needed]

### Citation Information

[More Information Needed]

### Contributions

[More Information Needed]