<commit_before># WordPoints Dev Lib [![Build Status](https://travis-ci.org/WordPoints/dev-lib.svg?branch=master)](https://travis-ci.org/WordPoints/dev-lib)
Developer tools for WordPoints projects.

## Installation

It is intended that this repo be included in a project repo via git-submodule in a
`dev-lib/` directory.

```bash
git submodule add https://github.com/WordPoints/dev-lib.git dev-lib
```

To update:

```bash
git submodule update --remote dev-lib
```

After updating it is recommended that you update run the `init` script again, as
shown below.

## Set Up

### Modules

```bash
dev-lib/bin/run init
```

### Other

If your project is not a module, or it is using a different path to the dev-lib, you
will need to first configure the dev-lib by creating a `.wordpoints-dev-lib-config.sh`
file in the root of your project. In it, you can define the project type and/or 
dev-lib path using the `$WORDPOINTS_PROJECT_TYPE` and  `$DEV_LIB_PATH` variables,
respectively.

To define the project type:

```bash
export WORDPOINTS_PROJECT_TYPE=plugin
```

To define the dev-lib path:

```bash
export DEV_LIB_PATH=custom-dev-lib-path
```

From then on, you will be able to run `dev-lib/bin/run init` as shown above to 
initialize and update the dev lib. You will also be able to run the other scripts
included in the dev lib.<commit_msg>Fix incorrect command example in readme<commit_after># WordPoints Dev Lib [![Build Status](https://travis-ci.org/WordPoints/dev-lib.svg?branch=master)](https://travis-ci.org/WordPoints/dev-lib)
Developer tools for WordPoints projects.

## Installation

It is intended that this repo be included in a project repo via git-submodule in a
`dev-lib/` directory.

```bash
git submodule add https://github.com/WordPoints/dev-lib.git dev-lib
```

To update:

```bash
git submodule update --remote dev-lib
```

After updating it is recommended that you update run the `init` script again, as
shown below.

## Set Up

### Modules

```bash
dev-lib/run init
```

### Other

If your project is not a module, or it is using a different path to the dev-lib, you
will need to first configure the dev-lib by creating a `.wordpoints-dev-lib-config.sh`
file in the root of your project. In it, you can define the project type and/or 
dev-lib path using the `$WORDPOINTS_PROJECT_TYPE` and  `$DEV_LIB_PATH` variables,
respectively.

To define the project type:

```bash
export WORDPOINTS_PROJECT_TYPE=plugin
```

To define the dev-lib path:

```bash
export DEV_LIB_PATH=custom-dev-lib-path
```

From then on, you will be able to run `dev-lib/bin/run init` as shown above to 
initialize and update the dev lib. You will also be able to run the other scripts
included in the dev lib.
{'fraction_non_alphanumeric': 0.10185185185185185, 'fraction_numerical': 0.0, 'mean_word_length': 4.244660194174758, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 6, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '3033815', 'n_tokens_mistral': 878, 'n_tokens_neox': 841, 'n_words': 350}