<commit_before>Supporting shell scripts
========================

Shell scripts that support the build process are located in this directory, and typically called by a shell 
script provisioner in packer. See the [packer documentation](https://www.packer.io/docs/provisioners/shell.html) 
for more information.

#### housekeeper ####
This shell script is responsible for truncating log files that were generated during the AMI build process, and 
clearing out any ssh keys that were configured by cloud-init.<commit_msg>Clarifying the directory's purpose in README.md<commit_after>Supporting shell scripts
========================

Shell scripts that support the build process are located in this directory, and typically called by a shell 
script provisioner in packer. See the [packer documentation](https://www.packer.io/docs/provisioners/shell.html) 
for more information.

The scripts in nubis-builder/bin are build tool helpers, and will run on the local system. All of the scripts
in here will be ran on the build target during the build process.

#### housekeeper ####
This shell script is responsible for truncating log files that were generated during the AMI build process, and 
clearing out any ssh keys that were configured by cloud-init.
{'fraction_non_alphanumeric': 0.09192645883293366, 'fraction_numerical': 0.0, 'mean_word_length': 5.137254901960785, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 2, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '4290590', 'n_tokens_mistral': 301, 'n_tokens_neox': 295, 'n_words': 158}