<commit_before>Eclogues
========

*The Eclogues (/ˈɛklɒɡz/; Latin: Eclogae [ˈɛklɔɡaj]), also called the Bucolics, is the first of the three major works of the Latin poet Virgil.*

Dependencies
------------

Requires Apache [Mesos](http://mesos.apache.org) and [Aurora](http://aurora.apache.org/) 0.7.0.

The [thrift](http://hackage.haskell.org/package/thrift) dependency does not build
due to [a bug in the .cabal file](https://issues.apache.org/jira/browse/THRIFT-3003),
and has some [interop issues](https://issues.apache.org/jira/browse/THRIFT-3145).
Clone it from [the GitHub mirror](https://github.com/apache/thrift) and apply the
included `thrift-fixes.patch` before `cabal install`.

Requires the master branch of [servant-pandoc](https://github.com/mpickering/servant-pandoc)
until that's published to Hackage.

Running
-------

```
cabal build
cp dist/build/eclogues-subexecutor/eclogues-subexecutor SLAVE_PATH
dist/build/eclogues-api/eclogues-api SHARED_JOBS_DIR ZOOKEEPER:2181,ADDRESSES:2181 THIS_HOST
xdg-open http://localhost:8000
```

API
---

### GET `/jobs`
List all jobs.

### GET `/job/:name`
Information about a particular job.<commit_msg>DOC: Add subexecutor config file to README<commit_after>Eclogues
========

*The Eclogues (/ˈɛklɒɡz/; Latin: Eclogae [ˈɛklɔɡaj]), also called the Bucolics, is the first of the three major works of the Latin poet Virgil.*

Dependencies
------------

Requires Apache [Mesos](http://mesos.apache.org) and [Aurora](http://aurora.apache.org/) 0.7.0.

The [thrift](http://hackage.haskell.org/package/thrift) dependency does not build
due to [a bug in the .cabal file](https://issues.apache.org/jira/browse/THRIFT-3003),
and has some [interop issues](https://issues.apache.org/jira/browse/THRIFT-3145).
Clone it from [the GitHub mirror](https://github.com/apache/thrift) and apply the
included `thrift-fixes.patch` before `cabal install`.

Requires the master branch of [servant-pandoc](https://github.com/mpickering/servant-pandoc)
until that's published to Hackage.

Running
-------

```
cabal build
cp dist/build/eclogues-subexecutor/eclogues-subexecutor SLAVE_PATH
echo '{"jobsDir":"SHARED_JOBS_DIR"}' > SLAVE_MACHINE/etc/eclogues/subexecutor.json
dist/build/eclogues-api/eclogues-api SHARED_JOBS_DIR ZOOKEEPER:2181,ADDRESSES:2181 THIS_HOST
xdg-open http://localhost:8000
```

API
---

### GET `/jobs`
List all jobs.

### GET `/job/:name`
Information about a particular job.
{'fraction_non_alphanumeric': 0.15362438220757826, 'fraction_numerical': 0.018945634266886325, 'mean_word_length': 4.533029612756264, 'pattern_counts': {'":': 1, '<': 3, '<?xml version=': 0, '>': 4, 'https://': 8, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6755120', 'n_tokens_mistral': 935, 'n_tokens_neox': 888, 'n_words': 208}