task_categories:token-classification size_categories:1K<n<10K language:sl license:cc-by-sa-4.0 tweets code-mixing code-switching region:us
Janes-Preklop is a corpus of Slovene tweets that is manually annotated for code-switching (the use of words from two 
or more languages within one sentence or utterance), according to the supplied typology.
@misc{janes_preklop,
    title = {Tweet code-switching corpus Janes-Preklop 1.0},
    author = {Reher, {\v S}pela and Erjavec, Toma{\v z} and Fi{\v s}er, Darja},
    url = {http://hdl.handle.net/11356/1154},
    note = {Slovenian language resource repository {CLARIN}.{SI}},
    copyright = {Creative Commons - Attribution-{ShareAlike} 4.0 International ({CC} {BY}-{SA} 4.0)},
    issn = {2820-4042},
    year = {2017}
}
---
license: cc-by-sa-4.0
dataset_info:
  features:
  - name: id
    dtype: string
  - name: words
    sequence: string
  - name: language
    sequence: string
  splits:
  - name: train
    num_bytes: 410822
    num_examples: 1104
  download_size: 623816
  dataset_size: 412672
task_categories:
- token-classification
language:
- sl
tags:
- tweets
- code-mixing
- code-switching
size_categories:
- 1K<n<10K
---
  
# Dataset Card for Janes-Preklop

### Dataset Summary

Janes-Preklop is a corpus of Slovene tweets that is manually annotated for code-switching: the use of words from two 
or more languages within one sentence or utterance.

### Languages

Code-switched Slovenian.

## Dataset Structure

### Data Instances

A sample instance from the dataset - each word is annotated with its language, either `"default"` 
(Slovenian/unclassifiable), `en` (English), `de` (German), `hbs` (Serbo-Croatian), `sp` (Spanish), 
`la` (Latin), `ar` (Arabic), `fr` (French), `it` (Italian), or `pt` (Portuguese).
```
{
    'id': 'tid.397447931558895616', 
    'words': ['Brad', 'Pitt', 'na', 'Planet', 'TV', '.', 'U', 'are', 'welcome', ';)'], 
    'language': ['default', 'default', 'default', 'default', 'default', 'default', 'B-en', 'I-en', 'I-en', 'I-en']
}
```

### Data Fields

- `id`: unique identifier of the example; 
- `words`: words in the sentence;
- `language`: language of each word.

## Additional Information

### Dataset Curators

Špela Reher, Tomaž Erjavec, Darja Fišer.

### Licensing Information

CC BY-SA 4.0.

### Citation Information

```
@misc{janes_preklop,
  title = {Tweet code-switching corpus Janes-Preklop 1.0},
  author = {Reher, {\v S}pela and Erjavec, Toma{\v z} and Fi{\v s}er, Darja},
  url = {http://hdl.handle.net/11356/1154},
  note = {Slovenian language resource repository {CLARIN}.{SI}},
  copyright = {Creative Commons - Attribution-{ShareAlike} 4.0 International ({CC} {BY}-{SA} 4.0)},
  issn = {2820-4042},
  year = {2017}
}
```

### Contributions

Thanks to [@matejklemen](https://github.com/matejklemen) for adding this dataset.