<commit_before># libab
[![Circle CI](https://circleci.com/gh/Preetam/libab.svg?style=svg&circle-token=2aa19d53d438447eae03021c0e99571e8ceb5207)](https://circleci.com/gh/Preetam/libab) [![License](https://img.shields.io/badge/License-BSD%203--Clause-blue.svg)](https://github.com/Preetam/libab/blob/master/LICENSE)

The [Background](https://github.com/Preetam/libab/blob/master/background.md) has details about this projects.

## Dependencies and Building

You will need a compiler that supports C++14. Only Linux and OS X are supported at the moment.

This repository uses submodules. The following will fetch them if you haven't done so already:

```sh
$ git submodule update --init --recursive
```

You will also need CMake version 3.0 or higher.

### Building

```sh
$ mkdir build && cd build
$ cmake ..
$ make
$ sudo make install # Optional
```

## License

BSD (see LICENSE)<commit_msg>Change FreeBSD info [ci skip]<commit_after># libab
[![Circle CI](https://circleci.com/gh/Preetam/libab.svg?style=svg&circle-token=2aa19d53d438447eae03021c0e99571e8ceb5207)](https://circleci.com/gh/Preetam/libab) [![License](https://img.shields.io/badge/License-BSD%203--Clause-blue.svg)](https://github.com/Preetam/libab/blob/master/LICENSE)

The [Background](https://github.com/Preetam/libab/blob/master/background.md) has details about this projects.

## Dependencies and Building

You will need a compiler that supports C++14. Linux, OS X, and FreeBSD are supported at the moment.
Builds may succeed with other BSDs, but they have not been verified.

If you're using FreeBSD, you will need to install `libexecinfo`. You can do that using `pkg`:

```sh
# pkg install libexecinfo
```

This repository uses submodules. The following will fetch them if you haven't done so already:

```sh
$ git submodule update --init --recursive
```

You will also need CMake version 3.0 or higher.

### Building

```sh
$ mkdir build && cd build
$ cmake ..
$ make
$ sudo make install # Optional
```

## License

BSD (see LICENSE)
{'fraction_non_alphanumeric': 0.13323353293413173, 'fraction_numerical': 0.033932135728542916, 'mean_word_length': 4.6798866855524075, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 10, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2906525', 'n_tokens_mistral': 723, 'n_tokens_neox': 651, 'n_words': 193}