<commit_before>Smart Chinese Analysis for ElasticSearch
==================================

The Smart Chinese Analysis plugin integrates Lucene Smart Chinese analysis module into elasticsearch.

In order to install the plugin, simply run: `bin/plugin -install elasticsearch/elasticsearch-analysis-smartcn/1.0.0`.

    --------------------------------------------------
    | Smart Chinese Analysis Plugin | ElasticSearch  |
    --------------------------------------------------
    | master                        | 0.18 -> master |
    --------------------------------------------------
    | 1.0.0                         | 0.18 -> master |
    --------------------------------------------------

The plugin includes the `smartcn` analyzer, `smartcn_sentence` tokenizer, and `smartcn_word` token filter.<commit_msg>fix analyzer name<commit_after>Smart Chinese Analysis for ElasticSearch
==================================

The Smart Chinese Analysis plugin integrates Lucene Smart Chinese analysis module into elasticsearch.

In order to install the plugin, simply run: `bin/plugin -install elasticsearch/elasticsearch-analysis-smartcn/1.0.0`.

    --------------------------------------------------
    | Smart Chinese Analysis Plugin | ElasticSearch  |
    --------------------------------------------------
    | master                        | 0.18 -> master |
    --------------------------------------------------
    | 1.0.0                         | 0.18 -> master |
    --------------------------------------------------

The plugin includes the `smart_chinese` analyzer, `smartcn_sentence` tokenizer, and `smartcn_word` token filter.
{'fraction_non_alphanumeric': 0.33657351154313486, 'fraction_numerical': 0.014580801944106925, 'mean_word_length': 1.253077975376197, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 7, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6451050', 'n_tokens_mistral': 341, 'n_tokens_neox': 311, 'n_words': 105}