<commit_before>jubatus_core
============

jubatus_core is the core library of Jubatus.

See http://jubat.us/ for details of Jubatus.

How to install
-----------

We officially support Ubuntu Server 12.04 LTS (x86_64) and Red Hat Enterprise Linux 6.2 or later (x86_64).

If you have already installed Jubatus 0.6.0 or later, you can already use jubatus_core.
`QuickStart <http://jubat.us/en/quickstart.html>`_ describes how to install Jubatus.
If you do not want to install whole Jubatus, you can install jubatus_core only.
Before installation, you should install msgpack and oniguruma (oniguruma is optional).
Then type as following:

::

    wget -O jubatus_core-master.tar.gz https://github.com/jubatus/jubatus_core/archive/master.tar.gz
    tar xf jubatus_core-master.tar.gz
    cd jubatus_core-master
    ./waf configure --prefix=<prefix>
    ./waf
    ./waf --checkall
    ./waf install


If you do not need oniguruma, type

::

    ./waf configure --regexp-library=none --prefix=<prefix>


instead of

::

    ./waf configure --prefix=<prefix>

If you want to use re2 instead of oniguruma, add ``--regexp-library=re2`` to ``./waf configure``.

License
-------

LGPL 2.1

Third-party library included in jubatus_core
----------------------------------------------

Jubatus source tree includes following third-party library.

- Eigen_ (mainly under MPL2 License, while some codes are under LPGL2.1 or LGPL2.1+)

.. _Eigen: http://eigen.tuxfamily.org

Update history
--------------

Update history can be found from `ChangeLog <https://github.com/jubatus/jubatus/blob/master/ChangeLog.rst>`_ or `WikiPage <https://github.com/jubatus/jubatus/wiki/ChangeLog>`_.

Contributors
------------

Contributors are listed at https://github.com/jubatus/jubatus/contributors and https://github.com/jubatus/jubatus_core/contributors.
<commit_msg>Fix README to link correct changelog.<commit_after>jubatus_core
============

jubatus_core is the core library of Jubatus.

See http://jubat.us/ for details of Jubatus.

How to install
-----------

We officially support Ubuntu Server 12.04 LTS (x86_64) and Red Hat Enterprise Linux 6.2 or later (x86_64).

If you have already installed Jubatus 0.6.0 or later, you can already use jubatus_core.
`QuickStart <http://jubat.us/en/quickstart.html>`_ describes how to install Jubatus.
If you do not want to install whole Jubatus, you can install jubatus_core only.
Before installation, you should install msgpack and oniguruma (oniguruma is optional).
Then type as following:

::

    wget -O jubatus_core-master.tar.gz https://github.com/jubatus/jubatus_core/archive/master.tar.gz
    tar xf jubatus_core-master.tar.gz
    cd jubatus_core-master
    ./waf configure --prefix=<prefix>
    ./waf
    ./waf --checkall
    ./waf install


If you do not need oniguruma, type

::

    ./waf configure --regexp-library=none --prefix=<prefix>


instead of

::

    ./waf configure --prefix=<prefix>

If you want to use re2 instead of oniguruma, add ``--regexp-library=re2`` to ``./waf configure``.

License
-------

LGPL 2.1

Third-party library included in jubatus_core
----------------------------------------------

Jubatus source tree includes following third-party library.

- Eigen_ (mainly under MPL2 License, while some codes are under LPGL2.1 or LGPL2.1+)

.. _Eigen: http://eigen.tuxfamily.org

Update history
--------------

Update history can be found from `ChangeLog <https://github.com/jubatus/jubatus_core/blob/master/ChangeLog.rst>`_.

Contributors
------------

Contributors are listed at https://github.com/jubatus/jubatus/contributors and https://github.com/jubatus/jubatus_core/contributors.

{'fraction_non_alphanumeric': 0.14933993399339934, 'fraction_numerical': 0.014301430143014302, 'mean_word_length': 3.009922822491731, 'pattern_counts': {'":': 0, '<': 14, '<?xml version=': 0, '>': 14, 'https://': 9, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '7404264', 'n_tokens_mistral': 1232, 'n_tokens_neox': 1172, 'n_words': 366}