<commit_before>To build the service libraries and binary under an UNIX operating
system you will need:

  An ANSI-C compliant compiler (GCC is good)
  A Java Platform 2 compliant SDK
  GNU AutoConf (when building for SVN).

When building from SVN sources you need to build the "configure" program with:

   sh support/buildconf.sh
(Note it is possible to replace sh by any compatible shell like bash, ksh).

Once the configure script is generated, run it (remember to specify
either the --with-java=<dir> parameter or set the JAVA_HOME environment
to point to your JDK installation. For example:

  ./configure --with-java=/usr/java

or

  JAVA_HOME=/usr/java
  export JAVA_HOME
  ./configure

or (when using gcj (use fastjar for jar))
  JAVAC=gcj; export JAVAC
  JAVACFLAGS=-c; export JAVACFLAGS
  ./configure

Note: On Mac OS X <dir> is /System/Library/Frameworks/JavaVM.framework/Home.

If your operating system is supported, configure will go thru cleanly,
otherwise it will report an error (please send us the details of your
OS/JDK, or a patch against the sources). To build the binaries and
libraries simply do:

  make<commit_msg>Update INSTALL.txt with new params<commit_after>To build the service libraries and binary under an UNIX operating
system you will need:

  An ANSI-C compliant compiler (GCC is good)
  A Java Platform 2 compliant SDK
  GNU AutoConf (when building for SVN).

When building from SVN sources you need to build the "configure" program with:

   sh support/buildconf.sh
(Note it is possible to replace sh by any compatible shell like bash, ksh).

Once the configure script is generated, run it (remember to specify
either the --with-java=<dir> parameter or set the JAVA_HOME environment
to point to your JDK installation. For example:

  ./configure --with-java=/usr/java

or

  JAVA_HOME=/usr/java
  export JAVA_HOME
  ./configure

Note: On Mac OS X <dir> is /System/Library/Frameworks/JavaVM.framework/Home.

Depending on your JDK layout, configure might fail to find the JNI
machine dependant include file (jni_md.h). If that's the case use the
--with-os-type=<subdir> parameter where subdir points to the directory
within JDK include directory containing jni_md.h file.


If your operating system is supported, configure will go thru cleanly,
otherwise it will report an error (please send us the details of your
OS/JDK, or a patch against the sources).

To build the binaries and libraries simply do:

  make
{'fraction_non_alphanumeric': 0.06012269938650307, 'fraction_numerical': 0.0008179959100204499, 'mean_word_length': 4.032921810699588, 'pattern_counts': {'":': 0, '<': 8, '<?xml version=': 0, '>': 8, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2856364', 'n_tokens_mistral': 733, 'n_tokens_neox': 678, 'n_words': 348}