size_categories:1M<n<10M language:sv license:cc-by-4.0 diachronic semantic change region:us
This is a dataset of text from the Riksdag, Sweden's legislative body. 

The original data is availble without a license under the Re-use of Public Administration Documents Act (2010:566) at https://data.riksdagen.se/data/dokument

This dataset is derivative of a version compiled by Språkbanken Text (SBX) at the University of Gothenburg (Sweden). That version consists of XML files split by document source (motions, questions, protocol, etc.) and includes additional linguistic annotations. It is available under a CC BY 4.0 license at https://spraakbanken.gu.se/resurser/rd 

The focus of this huggingface dataset is to organise the data for fine-grained diachronic modeling. To that end, this dataset includes two configurations:

# Configurations

## `sentences`

This configuration provides sentences in raw text format with their original whitespace. Sentence-level tokenisation was performed by Språkbanken. 

`datasets.load_dataset('ChangeIsKey/open-riksdag', 'sentences', years=YEARS, sources=SOURCES)`

- `YEARS:list(int)` - years in the range [1960, 2022] from which sentences are drawn
- `SOURCES:list(str)` - the Open Riksdag data is split into different data sources
    - `bet` _Betänkande_ ~ reports
    - `ds` 
    - `eun` _EUN_ ~ documents from the EU committee
    - `flista` _Föredragningslistor_ ~ Lists of speeches
    - `fpm` _faktapromemorior_  ~ factual memoranda on EU commission proposals 
    - `frsrdg` _Framställning/redogörelse_ ~ petitions and reports from bodies appointed by the Riksdag
    ...

data fields

- `sentence` - 
- `date` - 
- `source`
- `document_id`
...


## `targets-103`

- `target_lemma`
- `start`
- `end`

In a nutshell, this version offers:

- all sentences including one or more of 103 target words, which were chosen by TF-IDF (described below)
- per-month subsets (with all document types combined)
- one line per sentence (sentences shorter than 4 words were discarded)
- data includes: date, source, document_id, target_word, and text.

License is CC BY 4.0 with attribution.
---
language:
- sv
license: cc-by-4.0
size_categories:
- 1M<n<10M
pretty_name: Open Riksdag-103
tags:
- diachronic
- semantic change
---

This is a dataset of text from the Riksdag, Sweden's national legislative body. 

The original data is availble without a license under the Re-use of Public Administration Documents Act (2010:566) at https://data.riksdagen.se/data/dokument

This dataset is derivative of a version compiled by Språkbanken Text (SBX) at the University of Gothenburg (Sweden). That version consists of XML files split by source document type (motions, questions, protocol, etc.) and includes additional linguistic annotations. It is available under a CC BY 4.0 license at https://spraakbanken.gu.se/resurser/rd 

The focus of this huggingface dataset is to organise the data for fine-grained diachronic modeling. In a nutshell, this version offers:

- all sentences including one or more of 103 target words, which were chosen by TF-IDF (described below)
- per-month subsets (with all document types combined)
- one line per sentence (sentences shorter than 4 words were discarded)
- data includes: date, document_type, document_id, target_word, and text.

The dataset builder requires a `years` argument, which must be an interable of years between 1979 and 2019 (inclusive). This can be supplied to the `load_dataset` function as a keyword argument.
For example, to load raw sentences from the `prop` and `bet` data sources run:

```python
from datasets import load_dataset
data = load_dataset('ChangeIsKey/open-riksdag', 'sentences' years=range(1999,2000), sources=['prop', 'bet'])
```

License is CC BY 4.0 with attribution.
