<commit_before>## GOAL ##
LSTM example using Platoon.


## CONTENT ##
- README.txt
- lstm_controller.py
- lstm_worker.py
- imdb.py


## HOW TO USE ##
# USING THE LAUNCHER
1) Assuming you are in the lstm folder.
   `cd platoon/example/lstm/`

1) Launch the experiment on 2 GPUs using the platoon-launcher script.
   `platoon-launcher lstm gpu0 gpu2`

# MANUALLY
1) Assuming you are in the lstm folder.
   `cd platoon/example/lstm/`

2) Start the controller.
   `THEANO_FLAGS='device=cpu' python -u lstm_controller.py`

3) Start the worker. Repeat as needed changing the GPU id.
   `THEANO_FLAGS='device=gpu0' python -u lstm_worker.py`


## NOTE ##
If you use the MANUAL way, you may want to run them in different windows of screen or tmux.
They all expect to be in the foreground.<commit_msg>Update/fix lstm example readme<commit_after>## GOAL ##
LSTM example using Platoon.


## CONTENT ##
- README.txt
- lstm_controller.py
- lstm_worker.py
- imdb.py


## HOW TO USE ##
# USING THE LAUNCHER
1) Assuming you are in the lstm folder.
   `cd platoon/example/lstm/`

1) Launch the experiment on 2 GPUs using the platoon-launcher script.
   `platoon-launcher lstm -D cuda0 cuda2`

To see all controller parameters do: `python lstm_controller.py -h`
To pass them via the platoon-launcher script: `platoon-launcher lstm -D cuda0 cuda2 -c=...`

To see all worker parameters do: `python lstm_worker.py -h`
To pass them via the platoon-launcher script: `platoon-launcher lstm -D cuda0 cuda2 -w=...`

# MANUALLY
1) Assuming you are in the lstm folder.
   `cd platoon/example/lstm/`

2) Start the controller.
   `THEANO_FLAGS='device=cpu' python -u lstm_controller.py`

3) Start the worker. Repeat as needed changing the GPU id.
   `THEANO_FLAGS='device=gpu0' python -u lstm_worker.py`


## NOTE ##
If you use the MANUAL way, you may want to run them in different windows of screen or tmux.
They all expect to be in the foreground.
{'fraction_non_alphanumeric': 0.0948905109489051, 'fraction_numerical': 0.011470281543274244, 'mean_word_length': 3.6690997566909975, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '3913581', 'n_tokens_mistral': 732, 'n_tokens_neox': 685, 'n_words': 255}