<commit_before># Usage

To use the SurveyMan Mechanical Turk poster, follow the instructions listed [here] (https://github.com/etosch/SurveyMan/wiki/Build).

# Development

### Installation 

In order to all of the programs here, you will to have the following installed:

* Python 2.7
* numpy
* scipy
* matplotlib
* maven 
* make

If you have not used scipy before, note that it uses BLAS, so make sure you have a fortran compiler installed. While the programs can be run without use of matplotlib by providing arguments to suppress plotting, numpy is essenential for the program.

### Simulator

The SurveyMan is written in Python. It is designed as a testing environment for the application quality control metrics. The main entrypoint of the program is [launcher.py](https://github.com/etosch/surveyAutomation/blob/master/src/python/survey/launcher.py). To view options, type `python \relative\path\to\launcher.py help`.

To see how an example survey is constructed, run `python \relative\path\to\example_survey.py`. To test metrics, run `python \relative\path\to\metric-test.py`.

# License 
CRAPL - see [CRAPL](CRAPL-LICENSE).

<commit_msg>Fixed some typos.<commit_after># Usage

To use the SurveyMan Mechanical Turk poster, follow the instructions listed [here] (https://github.com/etosch/SurveyMan/wiki/Build).

# Development

### Installation 

In order to use all of the programs here, you will need to have the following installed:

* Python 2.7
* numpy
* scipy
* matplotlib
* maven 
* make

If you have not used scipy before, note that it uses BLAS, so make
sure you have a Fortran compiler installed. While the programs can be
run without use of matplotlib by providing arguments to suppress
plotting, numpy is essential for the program.

### Simulator

SurveyMan is written in Python. It is designed as a testing
environment for the application quality control metrics. The main
entrypoint of the program is
[launcher.py](https://github.com/etosch/surveyAutomation/blob/master/src/python/survey/launcher.py). To
view options, type `python \relative\path\to\launcher.py help`.

To see how an example survey is constructed, run `python \relative\path\to\example_survey.py`. To test metrics, run `python \relative\path\to\metric-test.py`.

# License 
CRAPL - see [CRAPL](CRAPL-LICENSE).


{'fraction_non_alphanumeric': 0.08394954327968682, 'fraction_numerical': 0.0017398869073510222, 'mean_word_length': 4.361305361305361, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 4, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '391878', 'n_tokens_mistral': 682, 'n_tokens_neox': 665, 'n_words': 279}