<commit_before>#1. Fork
Go to https://github.com/simonsfoundation/inferelator_ng and click "fork"

#2. Install the necessary packages:

```
sudo apt-get install python-dev
sudo apt-get install python-pip
pip install pandas
sudo apt-get install python-nose
sudo apt-get install git
```

#3. Cloning the forked `inferelator_ng` directory onto your machine

Go to the fork of `inferelator_ng` that's in your github (https://github.com/$USERNAME/inferelator_ng), and click "clone or download" to get `$URL`

Type in the terminal:

```
git clone $URL
```

For me, this was:

```git clone https://github.com/kostyat/inferelator_ng.git```

#4. Running the unit tests

Switch into the inferelator_ng directory:

```cd inferelator_ng/```

run nosetests (this runs the unit tests):

```
nosetests
```

Output should look like this:

```
.......S...............
----------------------------------------------------------------------
Ran 23 tests in 2.179s

OK (SKIP=1)
```

Each dot stands for a unit test that ran, "S" stands for "Skipped".

#5. Modify your files

```
cd inferelator_ng/
```

Change one of the files (for example the `utils.py` file), by adding a blank line or something.

#6. Run Unit Tests again to make sure everything still works

run nosetests (this runs the unit tests):

```
nosetests
```

#7. Push your changes to your Github directory

For each file you altered, run the following command:

```
git add utils.py
```

After you've done this for every file you've changed (in this case it's just 1 file), commit the changes to your fork by running:

```
git commit -m "fixed utils.py"
```

You might want to follow these instructions in case your name and email are not set properly (you should only need to do this once):

```
Your name and email address were configured automatically based
on your username and hostname. Please check that they are accurate.
You can suppress this message by setting them explicitly:

    git config --global user.name "<NAME>"
    git config --global user.email <EMAIL>

After doing this, you may fix the identity used for this commit with:

    git commit --amend --reset-author
```

```
git push
```

#7. Pull request

After you've done that, you should be able to find your modifications on your github

Then, to add these changes to the master repository, go to your github and click "new pull request".

Someone with write access to the master directory will look over your changes.<commit_msg>added notes for the process<commit_after>#1. Fork
Go to https://github.com/simonsfoundation/inferelator_ng and click "fork"

#2. Install the necessary packages:

```
sudo apt-get install python-dev
sudo apt-get install python-pip
pip install pandas
sudo apt-get install python-nose
sudo apt-get install git
```

#3. Cloning the forked `inferelator_ng` directory onto your machine

Go to the fork of `inferelator_ng` that's in your github (https://github.com/$USERNAME/inferelator_ng), and click "clone or download" to get `$URL`

Type in the terminal:

```
git clone $URL
```

For me, this was:

```git clone https://github.com/kostyat/inferelator_ng.git```

#4. Running the unit tests

Switch into the inferelator_ng directory:

```cd inferelator_ng/```

run nosetests (this runs the unit tests):

```
nosetests
```

Output should look like this:

```
.......S...............
----------------------------------------------------------------------
Ran 23 tests in 2.179s

OK (SKIP=1)
```

Each dot stands for a unit test that ran, "S" stands for "Skipped".

#5. Modify your files

```
cd inferelator_ng/
```

Change one of the files (for example the `utils.py` file), by adding a blank line or something.

#6. Run Unit Tests again to make sure everything still works

run nosetests (this runs the unit tests):

```
nosetests
```

#7. Push your changes to your Github directory

For each file you altered, run the following command:

```
git add utils.py
```

After you've done this for every file you've changed (in this case it's just 1 file), commit the changes to your fork by running:

```
git commit -m "fixed utils.py"
```

You might want to follow these instructions in case your name and email are not set properly (you should only need to do this once):

```
Your name and email address were configured automatically based
on your username and hostname. Please check that they are accurate.
You can suppress this message by setting them explicitly:

    git config --global user.name "<NAME>"
    git config --global user.email <EMAIL>

After doing this, you may fix the identity used for this commit with:

    git commit --amend --reset-author
```
Finally push the changes to your branch:
```
git push
```

#7. Pull request

After you've done that, you should be able to find your modifications on your github

Then, to add these changes to the master repository, go to your github and click "new pull request".

Someone with write access to the master directory will look over your changes.
{'fraction_non_alphanumeric': 0.12303030303030303, 'fraction_numerical': 0.006464646464646465, 'mean_word_length': 3.3775419982316532, 'pattern_counts': {'":': 0, '<': 7, '<?xml version=': 0, '>': 7, 'https://': 6, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '7165236', 'n_tokens_mistral': 1503, 'n_tokens_neox': 1411, 'n_words': 696}