<jupyter_start><jupyter_text>CleaningFrom time to time, it might be necessary to clean up your data disk and get back some memory. Here are a few convenience methods that allow you to do so. First, you need to load in the mui-module as usual.<jupyter_code>from multiply_ui.ui import mui<jupyter_output><empty_output><jupyter_text>The first option is to remove any cached data. Do this anytime you like.<jupyter_code>mui.clear_caches()<jupyter_output>404: Not Found<jupyter_text>The second option is to remove the working directories. Do this when there is no data in those directories that you want to keep.<jupyter_code>mui.clear_working_dirs()<jupyter_output><empty_output><jupyter_text>Next, you can choose to remove the auxiliary data from your disk. While this will give you some free space, the data will eventually be assembled again during future runs.<jupyter_code>mui.clear_auxiliary()<jupyter_output><empty_output><jupyter_text>Finally, you can remove any downloaded and stored EO Data. In most cases this will give you most free disk space by far, but future processings may be slower, as the time for data retrieval will be severely increased. Also, you will lose any preprocessed S2 Data.<jupyter_code>mui.clear_archive()<jupyter_output><empty_output>
{'fraction_non_alphanumeric': 0.05928853754940711, 'fraction_numerical': 0.0031620553359683794, 'mean_word_length': 6.234285714285714, 'pattern_counts': {'":': 0, '<': 20, '<?xml version=': 0, '>': 20, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 1, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'chain_length': '5', 'dir': 'jupyter-structured-clean-dedup', 'id': '225506', 'license': 'MIT', 'n_tokens_mistral': 377, 'n_tokens_neox': 366, 'n_words': 157, 'path': 'notebooks/MULTIPLY Cleaning.ipynb', 'repo_name': 'RaT0M/multiply-ui', 'size': '1265'}