<commit_before># paas-manager

Module to run MapReduce tasks with Hadoop.<commit_msg>Update README.md.<commit_after># paas-manager

Module to run MapReduce tasks with Hadoop.

## Installation for development

### Requirements

* Python 3.4
* pip
* MySQL server

### Setup

```
pip install --allow-external mysql-connector-python mysql-connector-python
pip install -r requirements.txt
cp config/paas_manager.local.yml.example config/paas_manager.local.yml
```

Fix settings in `config/paas_manager.local.yml`.

Run with

```
python runserver.py
```

## Modules

### DatabaseConnector

`DatabaseConnector` provides a basic ORM.

```python
class Users extends DatabaseConnector:
    table = users

user = Users.create({'email': '<EMAIL>', 'password': '<PASSWORD>'})
user.email = '<EMAIL>'
user.password = '<PASSWORD>'
user.save

assert(Users.find(user.id).id == Users.find_by({'email': '<EMAIL>'}).id)

user.update({'email': '<EMAIL>', 'password': '<PASSWORD>'})
assert(user.email == '<EMAIL>')

user.update_one('email', '<EMAIL>')
assert(user.email == '<EMAIL>')

user.delete()
```
{'fraction_non_alphanumeric': 0.1705282669138091, 'fraction_numerical': 0.0018535681186283596, 'mean_word_length': 5.27906976744186, 'pattern_counts': {'":': 0, '<': 13, '<?xml version=': 0, '>': 13, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '4057294', 'n_tokens_mistral': 369, 'n_tokens_neox': 358, 'n_words': 86}