size_categories:n<1K language:ja license:mit stopwords region:us
Japanese stopwords for nagisa.
---
license: mit
tags:
- stopwords
pretty_name: stopwords
size_categories:
- n<1K
language:
- ja
---

# Japanese stopwords for nagisa


This is a stopword list of frequently used words in the Japanese language, created according to the tokenization rules of the Japanese text analysis library, [nagisa](https://github.com/taishi-i/nagisa).

This list is constructed by extracting the top 100 most commonly used words from the [CC-100 dataset](https://data.statmt.org/cc-100/) and [Wikipedia](https://dumps.wikimedia.org/other/cirrussearch/).

To access this list of words, simply run the provided program code below.

Please install Huggingface datasets library.

```bash
$ pip install datasets
```

After installing the library, please run the following code next.

```python
from datasets import load_dataset

dataset = load_dataset("taishi-i/nagisa_stopwords")

# the top 100 most commonly used words
words = dataset["nagisa_stopwords"]["words"]

# the part-of-speech list for the top 100 most commonly used words
postags = dataset["nagisa_stopwords"]["postags"]
```
