<commit_before>
Cube Tools
==========

** THESE ROUTINES ARE UNTESTED AND STILL IN DEVELOPMENT. THEY WILL BE INCORPORATED IN A FUTURE RELEASE. **

This module provides classes to handle observational and simulated data. They are not complete and should not be used in their current form.

Once finished, each class will handle all of the pre-processing necessary for facilitating proper comparisons. For simulated data, this will include adding in realistic observational noise. For observational data, robust noise estimation will be completed using `signal_id <https://github.com/radio-astro-tools/signal-id>`_. Simple noise removal techniques may also become available.<commit_msg>remove spaces<commit_after>
Cube Tools
==========

**THESE ROUTINES ARE UNTESTED AND STILL IN DEVELOPMENT. THEY WILL BE INCORPORATED IN A FUTURE RELEASE.**

This module provides classes to handle observational and simulated data. They are not complete and should not be used in their current form.

Once finished, each class will handle all of the pre-processing necessary for facilitating proper comparisons. For simulated data, this will include adding in realistic observational noise. For observational data, robust noise estimation will be completed using `signal_id <https://github.com/radio-astro-tools/signal-id>`_. Simple noise removal techniques may also become available.
{'fraction_non_alphanumeric': 0.06149341142020498, 'fraction_numerical': 0.0, 'mean_word_length': 5.213636363636364, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 5, 'https://': 2, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5679467', 'n_tokens_mistral': 336, 'n_tokens_neox': 309, 'n_words': 176}