<commit_before>EDICT plugin
============

This plugin needs the EDICT dictionary file.
Download the file and convert it using the supplied scripts.

Usage
------------------
1. Run `./download.sh` to download edict -- or, download it manually to `./edict`.
2. Run `./convert.rb` to generate an indexed database that the plugin can use.

Disclaimer
------------------
I take no responsibility for this program should it cause any harm.<commit_msg>Fix dict filename in README.markdown of EDICT<commit_after>EDICT plugin
============

This plugin needs the EDICT dictionary file.
Download the file and convert it using the supplied scripts.

Usage
------------------
1. Run `./download.sh` to download edict -- or, download it manually to `./edict.txt`.
2. Run `./convert.rb` to generate an indexed database that the plugin can use.

Disclaimer
------------------
I take no responsibility for this program should it cause any harm.
{'fraction_non_alphanumeric': 0.16379310344827586, 'fraction_numerical': 0.004310344827586207, 'mean_word_length': 2.8230452674897117, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 8, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5878961', 'n_tokens_mistral': 234, 'n_tokens_neox': 225, 'n_words': 121}