<commit_before># integration-test2
2nd big integration test of all tools

Our new story is:
- TBD

How to run:

    python fetch.py

This downloads all the jars, compiles stuff, and downloads the corpus. Only needs to be run once unless you need to update tools or the corpus.

    python backend.py

Compiles the corpus projects, generates tests and dtrace files, computes dot files, runs petablox.

    python frontend.py

or

    python frontend.py imgscalr dyn4j

runs the main loop over the corpus, or the subset of corpus programs specified in the args.


Results of all tools running can be found on Travis:
[![Click here to see the Results of the experiments on TravisCI](https://travis-ci.org/aas-integration/integration-test.svg?branch=master)](https://travis-ci.org/aas-integration/integration-test)

---

- pip dependencies
script `map2annoAndAfu.py` needs an additional dependency named `glob2`. This one could be installed by `pip install glob2`.<commit_msg>update readme for script naming change<commit_after># integration-test2
2nd big integration test of all tools

Our new story is:
- TBD

How to run:

    python fetch.py

This downloads all the jars, compiles stuff, and downloads the corpus. Only needs to be run once unless you need to update tools or the corpus.

    python backend.py

Compiles the corpus projects, generates tests and dtrace files, computes dot files, runs petablox.

    python frontend.py

or

    python frontend.py imgscalr dyn4j

runs the main loop over the corpus, or the subset of corpus programs specified in the args.


Results of all tools running can be found on Travis:
[![Click here to see the Results of the experiments on TravisCI](https://travis-ci.org/aas-integration/integration-test.svg?branch=master)](https://travis-ci.org/aas-integration/integration-test)

---

- pip dependencies
script `map2annotation.py` needs an additional dependency named `glob2`. This one could be installed by `pip install glob2`.
{'fraction_non_alphanumeric': 0.0670391061452514, 'fraction_numerical': 0.006094464195022855, 'mean_word_length': 4.077319587628866, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 4, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 4, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '7333110', 'n_tokens_mistral': 579, 'n_tokens_neox': 537, 'n_words': 254}