<commit_before># Description

Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.

Fixes # (issue)

## Primary Components Effected

Please mark one option with an "x".

- [ ] Shifter (Core CLI and Server Application)
- [ ] Shifter UI (The Web Interface)
- [ ] Cross Component Configuration (.github workflows, templates, docs, .MD files)

## Type of change

Please mark one option with an "x".

- [ ] #RELEASE New Collection of Features (containing breaking and non-breaking changes)
- [ ] #FT New feature (non-breaking change which adds functionality, imrproves performance or code quality)
- [ ] #BUG Bug Fix (non-breaking change which fixes an issue)
- [ ] #PATCH Patch (non-breaking change which modifies only non-code object [Docs, Readme])

## Developer / Author Notes

Please feel free to provide any additional notes, content or context relating to this PR and subsequent contribution.<commit_msg>Adding error handling and logging across the board<commit_after># Description

Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.

Fixes # (issue)

## Primary Components Effected

Please mark one option with an "x".

- [ ] Shifter (Core CLI and Server Application)
- [ ] Shifter UI (The Web Interface)
- [ ] Cross Component Configuration (.github workflows, templates, docs, .MD files)

## Type of change

Please mark one option with an "x".

- [ ] #RELEASE New Collection of Features (containing breaking and non-breaking changes)
- [ ] #FT New feature (non-breaking change which adds functionality, improves performance or code quality)
- [ ] #BUG Bug Fix (non-breaking change which fixes an issue)
- [ ] #PATCH Patch (non-breaking change which modifies only non-code object [Docs, Readme])

## Developer / Author Notes

Please feel free to provide any additional notes, content or context relating to this PR and subsequent contribution.
{'fraction_non_alphanumeric': 0.0745697896749522, 'fraction_numerical': 0.0, 'mean_word_length': 4.339285714285714, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1860025', 'n_tokens_mistral': 538, 'n_tokens_neox': 511, 'n_words': 278}