<commit_before>## Singularity Extras for Mesos Slaves

*This assumes you've already followed the steps from [install.md](install.md)*

- `SingularityExecutor`, a custom Mesos executor
- `SingularityExecutorCleanup`, a background job that cleans up tasks that haven't been shut down cleanly (i.e. have been OOM killed or )
- `SingularityS3Uploader`, a local service that uploads task logs to S3
- `SingularityS3Downloader`, a local service that allows the executor to efficiently download files without being subject to OOM kills due to filling up the page cache.

### 1. Create base property config files.

`/etc/singularity.base.properties` -- properties used by all Singularity slave helpers.
<commit_msg>More info re: why SingularityExecutor is good<commit_after>## Singularity Extras for Mesos Slaves

*This document assumes you've already followed the steps from [install.md](install.md)*

- `SingularityExecutor`, a custom Mesos executor. This executor provides numerous benefits over the default Mesos executor, including:
  - Thread usage limits
  - Detailed status updates for tasks
  - Log rotation
  - Support for downloading multiple artifacts
  - "Embedded" artifacts (artifacts bundled into the Task object, as opposed to downloaded)
  - Log persistence in S3 (when used in conjunction with `SingularityS3Uploader`)
- `SingularityExecutorCleanup`, a background job that cleans up tasks that haven't cleanly terminated (i.e. have been OOM killed by OS, or the executor experiences a fatal error)
- `SingularityS3Uploader`, a local service that uploads task logs to S3
- `SingularityS3Downloader`, a local service that allows the executor to efficiently download files without being subject to OOM kills due to filling up the page cache.

### 1. Create base property config files.

`/etc/singularity.base.properties` -- properties used by all Singularity slave helpers.

{'fraction_non_alphanumeric': 0.06376195536663125, 'fraction_numerical': 0.005313496280552604, 'mean_word_length': 4.8478260869565215, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 6, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5175295', 'n_tokens_mistral': 507, 'n_tokens_neox': 486, 'n_words': 239}