<commit_before>clone repo

rsync .git to dir of interest

[Git ignore locally deleted folder](http://stackoverflow.com/questions/4589333/git-ignore-locally-deleted-folder)
git ls-files --deleted -z | git update-index --assume-unchanged -z --stdin

Add .gitignore file

[How to pull specific directory with git](http://stackoverflow.com/questions/2425059/how-to-pull-specific-directory-with-git)
git fetch
git checkout HEAD path/to/your/dir/or/file

make changes on new branch
git checkout -b make

Rebase
http://stackoverflow.com/questions/11563319/git-rebase-basics
https://www.atlassian.com/git/tutorials/rewriting-history/git-reflog
https://git-scm.com/docs/git-rebase

on branch "make" and rebase to move new-feature to the tip of master:
git checkout make
git rebase master

Standard fast-forward merge from master:
git checkout master
git merge new-feature
<commit_msg>Add context<commit_after>## Work around to keep track of only certain files 

### Setup
1. git clone the repository of interest
2. rsync .git directory of the clone to the directory of interest
3. In the new directory, [git ignore locally deleted folder](http://stackoverflow.com/questions/4589333/git-ignore-locally-deleted-folder)

    ```
git ls-files --deleted -z | git update-index --assume-unchanged -z --stdin
```

4. Add .gitignore file to ignore everything else

### Making changes (on a new branch)
Create a new branch
```
git checkout -b make
```
and git add/commit changes there.

### Rebase
Be on branch "make" and rebase to move new-feature to the tip of master:
```
git checkout make
git rebase master
```

Do standard fast-forward merge from master:
```
git checkout master
git merge new-feature
```

Rebase Reference:

- http://stackoverflow.com/questions/11563319/git-rebase-basics
- https://www.atlassian.com/git/tutorials/rewriting-history/git-reflog
- https://git-scm.com/docs/git-rebase

- [How to pull specific directory with git](http://stackoverflow.com/questions/2425059/how-to-pull-specific-directory-with-git)
    ```
git fetch
git checkout HEAD path/to/your/dir/or/file
```

{'fraction_non_alphanumeric': 0.11308950914340712, 'fraction_numerical': 0.023099133782483156, 'mean_word_length': 4.158808933002481, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 4, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6789880', 'n_tokens_mistral': 697, 'n_tokens_neox': 645, 'n_words': 209}