<commit_before>
# TermExtractJS

This is a module for retrieving technical terms from text data.
This module is a rewrite of [TermExtract](http://gensen.dl.itc.u-tokyo.ac.jp/termextract.html) for JavaScript.
TermExtract is based on the concept of ["technical term automatic extraction system"](http://www.forest.eis.ynu.ac.jp/Forest/ja/term-extraction.html) created by Professor <NAME> of Tokyo University and Associate Professor <NAME> of Yokohama National University.
Please refer to [these papers](http://www.r.dl.itc.u-tokyo.ac.jp/~nakagawa/academic-res/jnlp10-1.pdf), for that principle.

## Dependencies

**MeCab**

Can install from this site.

## Example

See `demo.js`

```sh
$ node demo.js
トライグラム,40.24922359499622
単語トライグラム,8.972092687327322
トライグラム統計,5.566315367427481
クラストライグラム,2.514866859365871
トライグラム抽出,2.514866859365871
単語トライグラム統計,2.492882871678434
```

## Contributing

1. Fork it!
2. Create your feature branch: `git checkout -b my-new-feature`
3. Commit your changes: `git commit -am 'Add some feature'`
4. Push to the branch: `git push origin my-new-feature`
5. Submit a pull request :D

## License

MIT<commit_msg>docs: add link about MeCab<commit_after>
# TermExtractJS

This is a module for retrieving technical terms from text data.
This module is a rewrite of [TermExtract](http://gensen.dl.itc.u-tokyo.ac.jp/termextract.html) for JavaScript.
TermExtract is based on the concept of ["technical term automatic extraction system"](http://www.forest.eis.ynu.ac.jp/Forest/ja/term-extraction.html) created by Professor <NAME> of Tokyo University and Associate Professor <NAME> of Yokohama National University.
Please refer to [these papers](http://www.r.dl.itc.u-tokyo.ac.jp/~nakagawa/academic-res/jnlp10-1.pdf), for that principle.

## Dependencies

**MeCab**

For MeCab please visit [this site](http://taku910.github.io/mecab/).

## Example

See `demo.js`

```sh
$ node demo.js
トライグラム,40.24922359499622
単語トライグラム,8.972092687327322
トライグラム統計,5.566315367427481
クラストライグラム,2.514866859365871
トライグラム抽出,2.514866859365871
単語トライグラム統計,2.492882871678434
```

## Contributing

1. Fork it!
2. Create your feature branch: `git checkout -b my-new-feature`
3. Commit your changes: `git commit -am 'Add some feature'`
4. Push to the branch: `git push origin my-new-feature`
5. Submit a pull request :D

## License

MIT
{'fraction_non_alphanumeric': 0.11561691113028473, 'fraction_numerical': 0.0910267471958585, 'mean_word_length': 4.7975, 'pattern_counts': {'":': 0, '<': 7, '<?xml version=': 0, '>': 7, 'https://': 0, 'lorem ipsum': 0, 'www.': 4, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2419101', 'n_tokens_mistral': 1023, 'n_tokens_neox': 900, 'n_words': 236}