<commit_before>ambee copy-and-replace source-code source-code-as-words string-space-end-of-line-here-space string-placeholder-special amenn
ambee copy-and-replace source-code-as-words source-code-as-words string-placeholder-special character-space amenn
ambee copy-and-replace source-code-as-words source-code-as-words string-space-end-of-line-here-space string-placeholder-special amenn
ambee copy-and-replace source-code-as-words source-code-as-words string-placeholder-special character-space amenn
ambee copy-without-extra-spaces source-code-as-words source-code-as-words amenn
ambee convert-source-code-replace-parameter-brackets-with-ambee-and-amenn amenn
ambee copy-and-replace-using-paired-listed-words source-code-as-words source-code-as-words paired-replacements-for-converting-to-combee-comenn amenn
ambee copy-and-replace source-code-as-words source-code-as-words string-space-hyphen-here-space string-space-no-space-character-hyphen-no-space-space amenn
ambee copy-without-extra-spaces source-code-as-words source-code-as-words amenn

combee **** need to do at least twice because of potential overlap **** comenn
ambee put-into-phrase count-1-2  1 2  amenn
ambee use-handler-with-each-word-in-phrase convert-source-code-simplify-no-space-one-space-directives count-1-2  amenn

combee ****
ambee copy-and-replace source-code-as-words source-code-as-words string-space-one-space-space string-placeholder-for-space-one-space-space amenn
ambee copy-and-replace source-code-as-words source-code-as-words string-placeholder-for-space-one-space-space character-space amenn
**** comenn

ambee copy-and-replace-using-paired-listed-words source-code-as-words source-code-as-words paired-replacements-for-converting-hyphens-into-defenns amenn
ambee copy-and-replace source-code-as-words source-code-as-words string-space-hyphen-here-space string-replacement-for-hyphen-here amenn
ambee copy-without-extra-spaces source-code-as-words source-code-as-words amenn
ambee copy-and-replace source-code-as-words source-code-as-lines character-space character-newline amenn<commit_msg>Eliminate lines of code no longer needed now that a space is inserted at line breaks<commit_after>ambee copy-without-extra-spaces source-code source-code-as-words amenn
ambee convert-source-code-replace-parameter-brackets-with-ambee-and-amenn amenn
ambee copy-and-replace-using-paired-listed-words source-code-as-words source-code-as-words paired-replacements-for-converting-to-combee-comenn amenn
ambee copy-and-replace source-code-as-words source-code-as-words string-space-hyphen-here-space string-space-no-space-character-hyphen-no-space-space amenn
ambee copy-without-extra-spaces source-code-as-words source-code-as-words amenn

combee **** need to do at least twice because of potential overlap **** comenn
ambee put-into-phrase count-1-2  1 2  amenn
ambee use-handler-with-each-word-in-phrase convert-source-code-simplify-no-space-one-space-directives count-1-2  amenn

combee ****
ambee copy-and-replace source-code-as-words source-code-as-words string-space-one-space-space string-placeholder-for-space-one-space-space amenn
ambee copy-and-replace source-code-as-words source-code-as-words string-placeholder-for-space-one-space-space character-space amenn
**** comenn

ambee copy-and-replace-using-paired-listed-words source-code-as-words source-code-as-words paired-replacements-for-converting-hyphens-into-defenns amenn
ambee copy-and-replace source-code-as-words source-code-as-words string-space-hyphen-here-space string-replacement-for-hyphen-here amenn
ambee copy-without-extra-spaces source-code-as-words source-code-as-words amenn
ambee copy-and-replace source-code-as-words source-code-as-lines character-space character-newline amenn
{'fraction_non_alphanumeric': 0.11518885614787035, 'fraction_numerical': 0.0032145727297080095, 'mean_word_length': 4.889589905362776, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1887950', 'n_tokens_mistral': 1232, 'n_tokens_neox': 1193, 'n_words': 222}