<commit_before># toolkits

kinds of toolkits
========================

# elasticsearch export

binaries in path: `./binaries/elasticsearch-0.1.1.jar`

```Shell
java -DconfigPath ./`path`/elasticsearch-export.properties -jar elasticsearch-`version`.jar 
```

elasticsearch-export.properties

```Shell
#####################main####################
main=cn.huangchaosuper.toolkits.SimpleTask

#####################SimpleTask####################
simpletask.package=cn.huangchaosuper.toolkits.elasticsearch.export
<commit_msg>change readme<commit_after># toolkits

kinds of toolkits
========================

# elasticsearch export

[download](./binaries/elasticsearch-0.1.1.jar)

```Shell
java -DconfigPath ./`path`/elasticsearch-export.properties -jar elasticsearch-`version`.jar 
```

elasticsearch-export.properties

```Shell
#####################main####################
main=cn.huangchaosuper.toolkits.SimpleTask

#####################SimpleTask####################
simpletask.package=cn.huangchaosuper.toolkits.elasticsearch.export

{'fraction_non_alphanumeric': 0.30077369439071566, 'fraction_numerical': 0.005802707930367505, 'mean_word_length': 7.697478991596639, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 1, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5650988', 'n_tokens_mistral': 304, 'n_tokens_neox': 301, 'n_words': 44}