size_categories:100K<n<1M source_datasets:Kuvendi i Kosovës language:sq license:cc-by-4.0 region:us
---
language: sq
license: cc-by-4.0
size_categories:
- 100K<n<1M
source_datasets: Kuvendi i Kosovës
configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
dataset_info:
  features:
  - name: text
    dtype: string
  - name: speaker
    dtype: string
  - name: date
    dtype: string
  - name: id
    dtype: string
  - name: num_tokens
    dtype: int64
  splits:
  - name: train
    num_bytes: 161877950
    num_examples: 122174
  download_size: 82532060
  dataset_size: 161877950
---

# Kosovo-Parliament-Transcriptions

[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/Kushtrimvisoka/Kosovo-Parliament-Transcriptions/blob/main/Kosovo_Parliament_Transcriptions.ipynb)

The dataset comprises transcripts of speeches delivered by members of the Kosovo Assembly during parliamentary sessions spanning from 2007. The goal of this repository is to provide a valuable resource for researchers and professionals interested in natural language processing, or political discourse analysis.

# Data source

The dataset was compiled from publicly available transcripts published on the current and old official website of the Kosovo Assembly (https://kuvendikosoves.org/).

# Data Preperation

The dataset was compiled by downloading PDF files and converting them to a text format using OCR. The resulting text was then cleaned to fix punctuation and spelling errors. It's important to note that due to the complexity of the PDF-to-text conversion process, the dataset may still contain typos and other errors. As a result, the dataset is provided "as is". Additionally, it should be noted that the dataset includes speeches given in languages other than Albanian.

# To do

- [ ] Conduct additional quality assurance checks to identify and correct any remaining errors in the dataset.
- [ ] Add a column for the language of the speech.
- [ ] Add a column for the party of the speaker.

# Dataset structure

The dataset contains the following fields: text, speaker, date, id.

# Usage

```python

from datasets import load_dataset

dataset = load_dataset('Kushtrim/Kosovo-Parliament-Transcriptions')

```

# License

The dataset is licensed under the Creative Commons Attribution 4.0 International License (https://creativecommons.org/licenses/by/4.0/).

# Citation

If you use this dataset in your research, please consider citing this repository.