<jupyter_start><jupyter_text>OverviewThis notebook sets up the following directories for the final project.```project├── data├── LICENSE├── models├── notebooks│   └── 0_setup_project_folders.ipynb├── README.md├── report│   ├── interim.md│   ├── proposal.md│   └── report.md└── src```You are free to rename any the directory or add other directories. You can also switch the LICENSE to any other license type tha you prefer.<jupyter_code>import os

basedir = os.path.dirname(os.getcwd())

subdirs = ['src', 'data', 'models']
for d in subdirs:
    full_path = os.path.join(basedir, d)
    if not os.path.exists(full_path):
        os.makedirs(full_path)

assert all([os.path.exists(os.path.join(basedir, d)) for d in subdirs])
!tree ../<jupyter_output><empty_output>
{'fraction_non_alphanumeric': 0.14659685863874344, 'fraction_numerical': 0.0013089005235602095, 'mean_word_length': 4.8396946564885495, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 5, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'chain_length': '1', 'dir': 'jupyter-structured-clean-dedup', 'id': '488434', 'license': 'MIT', 'n_tokens_mistral': 269, 'n_tokens_neox': 274, 'n_words': 78, 'path': 'notebooks/0_setup_project_folders.ipynb', 'repo_name': 'cpsc6300/course-project-christina-hummel-and-sydney-brown', 'size': '764'}