<jupyter_start><jupyter_text>Content of `test.txt`<jupyter_code>! cat test.txt<jupyter_output>{AI} is  AWESOME! 123<jupyter_text>grep command<jupyter_code>! grep "shawn" test.*
! cp test.txt test2.txt<jupyter_output><empty_output><jupyter_text>`-i` case insensitive search from files starting with `test`<jupyter_code>! grep -i "AI" test*
! grep -i "s.*awe" test*
! echo "AI, this is good.\nNo, this's awesome" | grep 'is'
! echo "AI, this is good.\nNo, this's awesome" | grep -w 'is'<jupyter_output>AI, this is good.<jupyter_text>tr command Convert all uppercase to lowercase, return the lowercase content in `lowercase.txt`<jupyter_code>! tr '[:upper:]' '[:lower:]' <test.txt> lowercase.txt
! cat lowercase.txt<jupyter_output>{ai} is  awesome! 123<jupyter_text>Convert all lowercase to uppercase<jupyter_code>! cat test.txt | tr '[:lower:]' '[:upper:]'<jupyter_output>{AI} IS  AWESOME! 123<jupyter_text>Convert whitespace to tabs<jupyter_code>! cat test.txt | tr [:space:] '\t'<jupyter_output>{AI}	is		AWESOME!	123<jupyter_text>Convert braces into parenthesis<jupyter_code>! cat test.txt | tr '{}' '()'<jupyter_output>(AI) is  AWESOME! 123<jupyter_text>Convert multiple continuous spaces with a single space<jupyter_code>! cat test.txt | tr -s [:space:] ' '<jupyter_output>{AI} is AWESOME! 123<jupyter_text>Delete specified characters using `-d`<jupyter_code>! cat test.txt | tr -d 'a'<jupyter_output>{AI} is  AWESOME! 123<jupyter_text>Remove all the digits from the string<jupyter_code>! cat test.txt | tr -d [:digit:]<jupyter_output>{AI} is  AWESOME!<jupyter_text>Remove all characters except digits<jupyter_code>! cat test.txt | tr -cd [:digit:]<jupyter_output>123<jupyter_text>Character that is not 'a' is matched and translated to 'z'.<jupyter_code>! cat test.txt | tr -c 'a' 'z'<jupyter_output>zzzzzzzzzzzzzzzzzzzzzz<jupyter_text>Remove all non-printable character from a file<jupyter_code>! cat test.txt | tr -cd [:print:]<jupyter_output>{AI} is  AWESOME! 123<jupyter_text>sed command `s` is substitute<jupyter_code>! cat test.txt | sed 's/AI/Machine/g'<jupyter_output>{Machine} is  AWESOME! 123
{'fraction_non_alphanumeric': 0.14211026615969582, 'fraction_numerical': 0.014733840304182509, 'mean_word_length': 6.825278810408922, 'pattern_counts': {'":': 0, '<': 45, '<?xml version=': 0, '>': 45, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 1, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'chain_length': '14', 'dir': 'jupyter-structured-clean-dedup', 'id': '535986', 'license': 'BSD-2-Clause', 'n_tokens_mistral': 900, 'n_tokens_neox': 835, 'n_words': 199, 'path': 'bash.ipynb', 'repo_name': 'shawnngtq/bash', 'size': '2104'}