<jupyter_start><jupyter_text>Original<jupyter_code>print("Original captions:\n")
length_analysis(original)
print()
emoji_analysis(original)<jupyter_output>Original captions:

Length:
 - Number of images/captions = 34927
 - Average = 7.49
 - Std. devitation  = 13.86
 - Maximum = 402
 - Minimum = 1

Emojis:
 - Number of captions with emojis = 9056
 - % with emojis = 25.9284 %<jupyter_text>Preprocessed<jupyter_code>print("Preprocessed captions:\n")
length_analysis(preprocessed)
print()
emoji_analysis(preprocessed)<jupyter_output>Preprocessed captions:

Length:
 - Number of images/captions = 24669
 - Average = 6.94
 - Std. devitation  = 4.81
 - Maximum = 32
 - Minimum = 2

Emojis:
 - Number of captions with emojis = 7604
 - % with emojis = 30.8241 %
{'fraction_non_alphanumeric': 0.11390728476821192, 'fraction_numerical': 0.06622516556291391, 'mean_word_length': 4.518248175182482, 'pattern_counts': {'":': 0, '<': 7, '<?xml version=': 0, '>': 7, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'chain_length': '2', 'dir': 'jupyter-structured-clean-dedup', 'id': '661742', 'license': 'MIT', 'n_tokens_mistral': 324, 'n_tokens_neox': 274, 'n_words': 60, 'path': 'notebooks/instagram_captions.ipynb', 'repo_name': 'pabvald/instagram-caption-generator', 'size': '755'}