<jupyter_start><jupyter_text>1. answer the following2. why is the order of the output reversed3. what is the point of teacher forcingIf you make the chunks too large, the output doesn't correspond to words in the known dictionary. So it performs worse. The model also doesn't know where spaces are meant to go.<jupyter_code>code = ".- -. ... .-- . .-. /" + " - .... . /" + \
  " ..-. --- .-.. .-.. --- .-- .. -. --."
decode(code)
code = ".-- .... -.-- /" + " .. ... /" + " - .... . /" + \
  " --- .-. -.. . .-. /" + " --- ..-. /" + " - .... . /" + \
  " --- ..- - .--. ..- - /" + " .-. . ...- . .-. ... . -.."
decode(code)
code = ".-- .... .- - /" + " .. ... /" + " - .... . /" + \
  " .--. --- .. -. - /" + " --- ..-. /" + " - . .- -.-. .... . .-. /" + \
  " ..-. --- .-. -.-. .. -. --."
decode(code)<jupyter_output><empty_output><jupyter_text>Longer chunks<jupyter_code>code = ".-- .... .- - /" + " .. ... /" # what is
decode(code)
code = ".-- .... .- - /" + " .. ... /" # what is
decode(code)<jupyter_output><empty_output>
{'fraction_non_alphanumeric': 0.3570731707317073, 'fraction_numerical': 0.002926829268292683, 'mean_word_length': 1.0643863179074446, 'pattern_counts': {'":': 0, '<': 9, '<?xml version=': 0, '>': 9, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'chain_length': '2', 'dir': 'jupyter-structured-clean-dedup', 'id': '486215', 'license': 'MIT', 'n_tokens_mistral': 410, 'n_tokens_neox': 389, 'n_words': 63, 'path': '07_recurrent_networks/DL_Lab_7.ipynb', 'repo_name': 'samisnotinsane/deep-learning-soton', 'size': '1025'}