<commit_before>Scalarm Storage Manager
=======================

It constitutes a persistence layer for the Scalarm platform. It provides two services: a clustered MongoDB and
a Log Bank for saving binary output from simulations within data farming experiments.

To run the services you need to fulfill the following requirements:

* Ruby version

We are currently working with Rubinius 2.2.1 installed via RVM.

* System dependencies

Any dependency required by native gems.

* Configuration

You need one configuration file ('scalarm.yml') in the config folder.
In this file you put the following information in the YAML format:

```
# where is the Information Service
information_service_url: localhost:11300
information_service_user: secret_login
information_service_pass: <PASSWORD>

# where Log Bank should store content
mongo_host: 'localhost'
mongo_port: 27017
db_name: 'scalarm_db'
binaries_collection_name: 'simulation_files'

# MongoDB settings

# host is optional - the service will take local ip address if host is not provided
#host: localhost

# MongoDB instance settings
db_instance_port: 30000
db_instance_dbpath: ./../../scalarm_db_data
db_instance_logpath: ./../../log/scalarm_db.log

# MongoDB configsrv settings
db_config_port: 28000
db_config_dbpath: ./../../scalarm_db_config_data
db_config_logpath: ./../../log/scalarm_db_config.log

# MongoDB router settings
db_router_host: localhost
db_router_port: 27017
db_router_logpath: ./../../log/scalarm_db_router.log
```

In addition, you need to download a MongoDB package for your system and unpack it in the root folder of Storage Manager.
The folder should be named 'mongodb' - this name is hardcoded in Rakefile.
<commit_msg>Additional info about the second required config file.<commit_after>Scalarm Storage Manager
=======================

It constitutes a persistence layer for the Scalarm platform. It provides two services: a clustered MongoDB and
a Log Bank for saving binary output from simulations within data farming experiments.

To run the services you need to fulfill the following requirements:

* Ruby version

We are currently working with Rubinius 2.2.1 installed via RVM.

* System dependencies

Any dependency required by native gems.

* Configuration

You need two configuration files in the config folder.
In the first file, 'scalarm.yml', you put the following information in the YAML format:

```
# where is the Information Service
information_service_url: localhost:11300
information_service_user: secret_login
information_service_pass: <PASSWORD>

# where Log Bank should store content
mongo_host: 'localhost'
mongo_port: 27017
db_name: 'scalarm_db'
binaries_collection_name: 'simulation_files'

# MongoDB settings

# host is optional - the service will take local ip address if host is not provided
#host: localhost

# MongoDB instance settings
db_instance_port: 30000
db_instance_dbpath: ./../../scalarm_db_data
db_instance_logpath: ./../../log/scalarm_db.log

# MongoDB configsrv settings
db_config_port: 28000
db_config_dbpath: ./../../scalarm_db_config_data
db_config_logpath: ./../../log/scalarm_db_config.log

# MongoDB router settings
db_router_host: localhost
db_router_port: 27017
db_router_logpath: ./../../log/scalarm_db_router.log
```

The second file, 'thin.yml', is a standard configuration file for the Thin server (the Log Bank service is exposed through
this server):
```
pid: tmp/pids/thin.pid
log: log/thin.log
environment: production
socket: /tmp/scalarm_storage_manager.sock
```

In addition, you need to download a MongoDB package for your system and unpack it in the root folder of Storage Manager.
The folder should be named 'mongodb' - this name is hardcoded in Rakefile.

{'fraction_non_alphanumeric': 0.08148348673524634, 'fraction_numerical': 0.015159718462371413, 'mean_word_length': 5.017915309446254, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 5, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6550017', 'n_tokens_mistral': 1109, 'n_tokens_neox': 1015, 'n_words': 422}