<commit_before><commit_msg>note with the concept for the new virtual base<commit_after>
So... The "base" is going to get a bit more complex...

We need to provide flexibility in how the base gets created.

Here are the main points:

- foundation remains as-is, the bare image
- what is now the base, becomes "buri_base"
  - it's scope is everything not in the foundation, that buri itself wants, or are commonly useful at a basic level. (vim, tcpdump, etc)
- major "platform" things, that you'd not want to install every resnap, but should be optional, or switchable
  - the only one of this class for now is "oracle-java", which I would like to see switchable with openjdk, as it *would* be a better default...
- a local base layer, would run atop all the above, almost like a platform item that runs last (or maybe exactly like)
  - would be a part of a "local roles" folder
  - need to detect it somehow, as it will be only run if present (of course)
    - ansible has not yielded a nice way to do this yet...
    - buri front end could check

And the new setup would be something like:

Foundation AMI: foundation
      Base AMI: (foundation), buri_base, oracle_java, local_base

The new role of name "base" would really just be a meta file with:

dependencies:
- { role: base_buri )
- { role: oracle_java, when: buri_base_java }
- { role: base_local,  when: buri_base_local }


And we rely on the ordering here to control base_buri, which will depends foundation, then the java, and local, which may itself be a composite of dependencies.



{'fraction_non_alphanumeric': 0.0646830530401035, 'fraction_numerical': 0.0, 'mean_word_length': 3.687878787878788, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1313017', 'n_tokens_mistral': 442, 'n_tokens_neox': 427, 'n_words': 246}