<commit_before># Introduction

See CHANGES for a description of the project status. Also see the web site and wiki at UT Austin: 

* http://openccg.sf.net
* http://www.utcompling.com/wiki/openccg

This file contains the configuration and build instructions. Next you'll probably want to look at the tutorial on writing grammars in the human-friendly 'dot ccg' syntax on [the UT Austin OpenCCG wiki](http://www.utcompling.com/wiki/openccg/visccg-tutorial).

After that it may be helpful to look at the "native" grammar specification in "Specifying Grammars for OpenCCG: A Rough Guide" in docs/grammars-rough-guide.pdf, as well as the SAMPLE_GRAMMARS file for descriptions of the sample grammars that come with the distribution, including ones using the DotCCG syntax.  A (somewhat dated) programmer's guide to using the OpenCCG realizer appears in docs/realizer-manual.pdf.

This release also includes a broad English coverage grammar from the CCGBank and associated statistical models; see docs/ccgbank-README for details.


# Requirements

* Version 1.6 or later of the Java 2 SDK (http://java.sun.com)
* For ccg2xml and other tools, Python version 2.4 to 2.7 (http://www.python.org)


# Configuring your environment variables

The easiest thing to do is to set the environment variables JAVA_HOME and OPENCCG_HOME to the relevant locations on your system. Set JAVA_HOME to match the top level directory containing the Java installation you want to use.<commit_msg>Updated to mention need to copy over external libs.<commit_after># Introduction

See CHANGES for a description of the project status. Also see the web site and wiki at UT Austin: 

* http://openccg.sf.net
* http://www.utcompling.com/wiki/openccg

This file contains the configuration and build instructions. Next you'll probably want to look at the tutorial on writing grammars in the human-friendly 'dot ccg' syntax on [the UT Austin OpenCCG wiki](http://www.utcompling.com/wiki/openccg/visccg-tutorial).

After that it may be helpful to look at the "native" grammar specification in "Specifying Grammars for OpenCCG: A Rough Guide" in docs/grammars-rough-guide.pdf, as well as the SAMPLE_GRAMMARS file for descriptions of the sample grammars that come with the distribution, including ones using the DotCCG syntax.  A (somewhat dated) programmer's guide to using the OpenCCG realizer appears in docs/realizer-manual.pdf.

This release also includes a broad English coverage grammar from the CCGBank and associated statistical models; see docs/ccgbank-README for details.


# Requirements

* Version 1.6 or later of the Java 2 SDK (http://java.sun.com)
* For ccg2xml and other tools, Python version 2.4 to 2.7 (http://www.python.org)


# Libraries

If you're working with the latest source version from github, you'll need to download the external libraries from the latest release, as github discourages including binaries in their repos:

* Download the latest release from sourceforge (https://sourceforge.net/projects/openccg/)
* Unpack the archive and copy over the files from openccg/lib/.
* Build the latest source as described further below


# Configuring your environment variables

The easiest thing to do is to set the environment variables JAVA_HOME and OPENCCG_HOME to the relevant locations on your system. Set JAVA_HOME to match the top level directory containing the Java installation you want to use.
{'fraction_non_alphanumeric': 0.05731166912850812, 'fraction_numerical': 0.004726735598227474, 'mean_word_length': 4.587458745874588, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 1, 'lorem ipsum': 0, 'www.': 6, 'xml': 2}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1806564', 'n_tokens_mistral': 962, 'n_tokens_neox': 886, 'n_words': 456}