<jupyter_start><jupyter_text>[![Notebook Tutorial](__code/__all/notebook_tutorial.png)](https://neutronimaging.pages.ornl.gov/tutorial/notebooks/metadata_ascii_parser/)  Select your IPTS<jupyter_code>from __code.metadata_ascii_parser import *

from __code import system
system.System.select_working_dir()
from __code.__all import custom_style
custom_style.style()<jupyter_output><empty_output><jupyter_text>Select the metadata file<jupyter_code>o_file = MetadataAsciiParser(system.System.get_working_dir())
o_file.select_metadata_file()<jupyter_output><empty_output><jupyter_text>Select Metadata Info to Keep  **Allow users to define:** * reference_line_showing_end_of_metadata * start_of_data_after_how_many_lines_from_reference_line * index or label of time info column in big table<jupyter_code>o_meta = MetadataFileParser(filename=o_file.metadata_file, 
                            meta_type='mpt',
                            time_label='time/s',
                            reference_line_showing_end_of_metadata='Number of loops',
                            end_of_metadata_after_how_many_lines_from_reference_line=1)
o_meta.parse()

o_meta.select_data_to_keep()<jupyter_output><empty_output><jupyter_text>Select Output Folder and Filename of new Formated Metadata File<jupyter_code>o_meta.keep_only_columns_of_data_of_interest()
o_meta.select_output_location()<jupyter_output><empty_output>
{'fraction_non_alphanumeric': 0.08291636883488206, 'fraction_numerical': 0.0007147962830593281, 'mean_word_length': 5.666666666666667, 'pattern_counts': {'":': 0, '<': 17, '<?xml version=': 0, '>': 17, 'https://': 1, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'chain_length': '4', 'dir': 'jupyter-structured-clean-dedup', 'id': '169641', 'license': 'BSD-3-Clause', 'n_tokens_mistral': 465, 'n_tokens_neox': 454, 'n_words': 61, 'path': 'notebooks/metadata_ascii_parser.ipynb', 'repo_name': 'mabrahamdevops/python_notebooks', 'size': '1399'}