<commit_before># BTECH CS SEM IV

[![Build Status](https://travis-ci.org/agauniyal/cs-iv-algorithm.svg?branch=master)](https://travis-ci.org/agauniyal/cs-iv-algorithm)

####Build & Test Instructions:

```
chmod +x build.sh
```

Now for Release or Debug
```
./build.sh -DCMAKE_BUILD_TYPE=Release
./build.sh -DCMAKE_BUILD_TYPE=Debug
```

To test, use `./build.sh -DCMAKE_BUILD_TYPE=Debug`. Two executables will be created, `sample` and `tests` inside
`build/bin` directory. Run `tests` to confirm all tests are passing.
<commit_msg>Add appveyor build status badge in README.md<commit_after># BTECH CS SEM IV

[![Build Status](https://travis-ci.org/agauniyal/cs-iv-algorithm.svg?branch=master)](https://travis-ci.org/agauniyal/cs-iv-algorithm)
[![Build status](https://ci.appveyor.com/api/projects/status/krmgl0by1i1xa87a/branch/master?svg=true)](https://ci.appveyor.com/project/agauniyal/cs-iv-algorithm/branch/master)

####Build & Test Instructions:

```
chmod +x build.sh
```

Now for Release or Debug
```
./build.sh -DCMAKE_BUILD_TYPE=Release
./build.sh -DCMAKE_BUILD_TYPE=Debug
```

To test, use `./build.sh -DCMAKE_BUILD_TYPE=Debug`. Two executables will be created, `sample` and `tests` inside
`build/bin` directory. Run `tests` to confirm all tests are passing.

{'fraction_non_alphanumeric': 0.16179952644041043, 'fraction_numerical': 0.003946329913180742, 'mean_word_length': 5.009478672985782, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 6, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '34369', 'n_tokens_mistral': 467, 'n_tokens_neox': 454, 'n_words': 100}