<commit_before># yunity

This is the parent repo for all the projects. It's in progress right now, but soon this wlil be the one to check out to get started on the project.<commit_msg>Added more details setup instructions<commit_after># yunity

This is the entry point to the other repos, it has:
- git submodules for the individual projects
- some make tasks for doing some setup/update
- a pm2 configuration for running the services in development

## Quick start

```
git clone <EMAIL>:yunity/yunity.git
cd yunity
make setup
make
```

(the second call to `make` should be temporary, for some reason webpack doesn't build correctly first time round)

To start all the services run:

```
pm2 start pm2.json
```

(You can stop individual services like `pm2 stop django`)

Please create an issue if this doesn't work out the box for you, this is only the first iteration :)

## Initial setup

To do initial setup run:

```
make setup
```

This will:
- checkout the git submodules
- install all the python/npm/bower dependencies
- run the django migrations

It expects all __system__ things to be already installed:
- postgresql
- redis
- elasticsearch

## Updating

If you just want to generally update everything, you can run:

```
make
```
{'fraction_non_alphanumeric': 0.06612903225806452, 'fraction_numerical': 0.0032258064516129032, 'mean_word_length': 4.192468619246862, 'pattern_counts': {'":': 0, '<': 4, '<?xml version=': 0, '>': 4, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1284505', 'n_tokens_mistral': 351, 'n_tokens_neox': 337, 'n_words': 184}