<jupyter_start><jupyter_text>Get current directory<jupyter_code>import os
os.getcwd()<jupyter_output><empty_output><jupyter_text>Set the directory to main project folder<jupyter_code>os.chdir('/user-home/1001/DSX_Projects/sms-spam-filter-using-hortonworks/')<jupyter_output><empty_output><jupyter_text>Create the Spam Filter Scikit package folder<jupyter_code>! mkdir SpamFilterScikit
! mkdir SpamFilterScikit/SpamFilterScikit<jupyter_output>mkdir: cannot create directory ‘SpamFilterScikit’: File exists
mkdir: cannot create directory ‘SpamFilterScikit/SpamFilterScikit’: File exists<jupyter_text>Copying the scripts created to the package folder<jupyter_code>! cp scripts/setup2.py SpamFilterScikit/
! cp scripts/__init__.py SpamFilterScikit/SpamFilterScikit/
! cp scripts/LRModelScikit.py SpamFilterScikit/SpamFilterScikit/<jupyter_output><empty_output><jupyter_text>Building the Spam Filter Scikit egg<jupyter_code>os.chdir('/user-home/1001/DSX_Projects/sms-spam-filter-using-hortonworks/SpamFilterScikit')
! python setup2.py bdist_egg<jupyter_output>running bdist_egg
running egg_info
writing SpamFilterScikit.egg-info/PKG-INFO
writing top-level names to SpamFilterScikit.egg-info/top_level.txt
writing dependency_links to SpamFilterScikit.egg-info/dependency_links.txt
reading manifest file 'SpamFilterScikit.egg-info/SOURCES.txt'
writing manifest file 'SpamFilterScikit.egg-info/SOURCES.txt'
installing library code to build/bdist.linux-x86_64/egg
running install_lib
running build_py
copying SpamFilterScikit/__init__.py -> build/lib/SpamFilterScikit
copying SpamFilterScikit/LRModelScikit.py -> build/lib/SpamFilterScikit
creating build/bdist.linux-x86_64/egg
creating build/bdist.linux-x86_64/egg/SpamFilterScikit
copying build/lib/SpamFilterScikit/DataPipeline.py -> build/bdist.linux-x86_64/egg/SpamFilterScikit
copying build/lib/SpamFilterScikit/__init__.py -> build/bdist.linux-x86_64/egg/SpamFilterScikit
copying build/lib/SpamFilterScikit/LRModelScikit.py -> build/bdist.linux-x86_64/egg/SpamFilterScikit
byte-compiling build/bdist.linux-x[...]<jupyter_text>Egg file is created and available in the dist folder of the package<jupyter_code>! ls dist<jupyter_output>SpamFilterScikit-1.0-py2.7.egg
{'fraction_non_alphanumeric': 0.09185520361990951, 'fraction_numerical': 0.017194570135746608, 'mean_word_length': 7.63671875, 'pattern_counts': {'":': 0, '<': 22, '<?xml version=': 0, '>': 27, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'chain_length': '6', 'dir': 'jupyter-structured-clean-dedup', 'id': '236437', 'license': 'Apache-2.0', 'n_tokens_mistral': 870, 'n_tokens_neox': 822, 'n_words': 126, 'path': 'notebooks/Building the Spam Filter Scikit Egg.jupyter.ipynb', 'repo_name': 'kant/sms-spam-filter-using-hortonworks', 'size': '2210'}