<commit_before># Playbook for Running Benchmarks on Hosts

Benchmarks can be run on both "docker compatible" and "docker incompatible" (e.g. bare metal). Please look at the inventory file (hosts).

This playbook has three roles:
- bench - run benchmark on all hosts according to the command file (`roles/bench/vars/main.yml`), and collect result profiles to localhost
- parse - parse all result profiles and merge them into a CSV file by using each `parse.sh` script in the benchmark folder.
- show - get ready to visualize all benchmark results by launching a scipy-notebook docker container

#### usage
Check all the hosts in the inventory file (hosts), then
```bash
ansible-playbook bench.yml
```<commit_msg>Fix typo<commit_after># Playbook for Running Benchmarks on Hosts

Benchmarks can be run on both "docker compatible" and "docker incompatible" (e.g. bare metal). Please look at the inventory file (hosts).

This playbook has three roles:
- bench - run benchmark on all hosts according to the command file (`roles/bench/vars/main.yml`), and collect result profiles to localhost
- parse - parse all result profiles and merge them into a CSV file by using each `parse.sh` script in the benchmark folder.
- show - get ready to visualize all benchmark results by launching a scipy-notebook docker container

#### Usage
Check all the hosts in the inventory file (hosts), then
```bash
ansible-playbook bench.yml
```
{'fraction_non_alphanumeric': 0.07339449541284404, 'fraction_numerical': 0.0, 'mean_word_length': 4.453846153846154, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1040432', 'n_tokens_mistral': 400, 'n_tokens_neox': 358, 'n_words': 201}