<commit_before>NMIS Project v1.0
====================

#### Note: the NMIS project data is currently in a private repo. When it is publically released by the Nigerian Government, it will be contained within this repository.


1. Pull the repo and use ``pip`` to install Flask.

    pip install Flask

2. Follow the instructions in the pipeline folder to generate lga level json:

3. Cd to the "nmis" folder and run the local server

    python main.py

4. In your browser, go to:
    
    http://localhost:5000

<commit_msg>Instructions to symlink lgas folder.<commit_after>NMIS Project v1.0
====================

#### Note: the NMIS project data is currently in a private repo. When it is publically released by the Nigerian Government, it will be contained within this repository.


1. Pull the repo and use ``pip`` to install Flask.

    pip install Flask

2. Follow the instructions in the pipeline folder to generate lga level json. Symlink `pipeline/lgas` to `static/lgas` (`cd static && ln -sf ../pipeline/lgas lgas`).

3. Cd to the "nmis" folder and run the local server

    python main.py

4. In your browser, go to:
    
    http://localhost:5000


{'fraction_non_alphanumeric': 0.10440034512510785, 'fraction_numerical': 0.01725625539257981, 'mean_word_length': 3.53125, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '3761123', 'n_tokens_mistral': 342, 'n_tokens_neox': 318, 'n_words': 166}