<commit_before>SAS App Engine Jobmaster
========================

Overview
--------

The jobmaster is the daemon responsible for managing image builds within an App
Engine. It connects to the *rMake Message Bus*, and receives jobs from the *MCP
Dispatcher* via that bus. Each job is handled by a child process running in a
Linux cgroup namespace, and the finished product is uploaded back to *mint* via
its REST API. A jobmaster is included by default as part of the App Engine
Appliance, but they can also be run on additional nodes if more capacity is
needed.

Inside the container, *jobslave* is the process responsible for actually
creating the image. Jobmaster sets up the environment, monitors the process,
and proxies API requests back to mint.

Jobs are isolated in a cgroup namespace in order to limit access to the host
system from within the image build. Access to system block and character
devices is blocked, network access is limited to only jobmaster's own API<commit_msg>test replication to github<commit_after>SAS App Engine Jobmaster
========================
 
Overview
--------

The jobmaster is the daemon responsible for managing image builds within an App
Engine. It connects to the *rMake Message Bus*, and receives jobs from the *MCP
Dispatcher* via that bus. Each job is handled by a child process running in a
Linux cgroup namespace, and the finished product is uploaded back to *mint* via
its REST API. A jobmaster is included by default as part of the App Engine
Appliance, but they can also be run on additional nodes if more capacity is
needed.

Inside the container, *jobslave* is the process responsible for actually
creating the image. Jobmaster sets up the environment, monitors the process,
and proxies API requests back to mint.

Jobs are isolated in a cgroup namespace in order to limit access to the host
system from within the image build. Access to system block and character
devices is blocked, network access is limited to only jobmaster's own API
{'fraction_non_alphanumeric': 0.05829145728643216, 'fraction_numerical': 0.0, 'mean_word_length': 4.545961002785515, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '7260082', 'n_tokens_mistral': 485, 'n_tokens_neox': 455, 'n_words': 316}