<commit_before>#CMPU 331 Assignment 1

Create a new directory for your compilers project. All examples will assume the project
directory is named `cmpu-331`

##Clone this repository

Clone this repository into your `cmpu-331` directory.
```bash
$> cd cmpu-331
$> git clone <URL> LexicalAnalyzer
```
This will clone your private repository into `cmpu-331/LexicalAnalyzer`

The `URL` above is the URL to your private GitHub repository. This is the URL sent to you when you accepted the assignment. You can also find this URL in the GitHub UI.

##Maven

Move the settings.xml file to your ~/.m2 directory. You can remove the settings.xml file from your project directory.

## Validate
<commit_msg>Updated git documentation.<commit_after># CMPU 331 Assignment 1

Create a new directory to hold all of the assignments for your compilers project. All examples will assume the project directory is named `cmpu-331`

## Clone this repository

Clone this repository into your `cmpu-331` directory.

```bash
$> mkdir cmpu-331
$> cd cmpu-331
$> git clone <URL> LexicalAnalyzer
```

This will clone your private repository into `cmpu-331/LexicalAnalyzer`

The `<URL>` above is the URL to your private GitHub repository that was created when you accepted the assignment. You can also find this URL in the GitHub UI.

## Maven

Move the settings.xml file to your ~/.m2 directory. You can remove the settings.xml file from your project directory.

## Validate

{'fraction_non_alphanumeric': 0.0685121107266436, 'fraction_numerical': 0.02560553633217993, 'mean_word_length': 4.395522388059701, 'pattern_counts': {'":': 0, '<': 6, '<?xml version=': 0, '>': 11, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 4}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '155935', 'n_tokens_mistral': 434, 'n_tokens_neox': 399, 'n_words': 207}