<commit_before>Thanks for using ChoiceModels! This is an open source project that's part of the Urban Data Science Toolkit. Development and maintenance is a collaboration between UrbanSim Inc and U.C. Berkeley's Urban Analytics Lab. You can contact <NAME>, the lead developer, at `<EMAIL>`.


### If you have a problem:

- Take a look at the [open issues](https://github.com/UDST/choicemodels/issues) and [closed issues](https://github.com/UDST/choicemodels/issues?q=is%3Aissue+is%3Aclosed) to see if there's already a related discussion

- Open a new issue describing the problem -- if possible, include any error messages, the operating system and version of python you're using, and version of any libraries that may be relevant


### Feature proposals:

- Take a look at the [open issues](https://github.com/UDST/choicemodels/issues) and [closed issues](https://github.com/UDST/choicemodels/issues?q=is%3Aissue+is%3Aclosed) to see if there's already a related discussion

- Post your proposal as a new issue, so we can discuss it (some proposals may not be a good fit for the project)


### Contributing code:

- Create a new branch of `UDST/choicemodels`, or fork the repository to your own account

- Make your changes, following the existing styles for code and inline documentation

- Add [tests](https://github.com/UDST/choicemodels/tree/master/tests) if possible!

- Open a pull request to the `UDST/choicemodels` master branch, including a writeup of your changes -- take a look at some of the closed PR's for examples

- Current maintainers will review the code, suggest changes, and hopefully merge it!


### Incrementing the version number:

- Each pull request that changes substantive code should increment the development version number, e.g. from 0.2.dev7 to 0.2.dev8

- It works best to do this just before merging (in case other PR's are merged first, and so you know the date for the changelog and documentation)

- There are three places where the version number needs to be changed: 
  1. `setup.py`
  2. `choicemodels/__init__.py`
  3. `docs/source/index.rst`

- Please also add a section to `CHANGELOG.md` describing the changes!


### Updating the documentation: 

- See instructions in `docs/README.md`

<commit_msg>Updating docs<commit_after>Thanks for using ChoiceModels! This is an open source project that's part of the Urban Data Science Toolkit. Development and maintenance is a collaboration between UrbanSim Inc and U.C. Berkeley's Urban Analytics Lab. You can contact <NAME>, the lead developer, at `<EMAIL>`.


### If you have a problem:

- Take a look at the [open issues](https://github.com/UDST/choicemodels/issues) and [closed issues](https://github.com/UDST/choicemodels/issues?q=is%3Aissue+is%3Aclosed) to see if there's already a related discussion

- Open a new issue describing the problem -- if possible, include any error messages, the operating system and version of python you're using, and version of any libraries that may be relevant


### Feature proposals:

- Take a look at the [open issues](https://github.com/UDST/choicemodels/issues) and [closed issues](https://github.com/UDST/choicemodels/issues?q=is%3Aissue+is%3Aclosed) to see if there's already a related discussion

- Post your proposal as a new issue, so we can discuss it (some proposals may not be a good fit for the project)


## Contributing code:

- Create a new branch of `UDST/choicemodels`, or fork the repository to your own account

- Make your changes, following the existing styles for code and inline documentation

- Add [tests](https://github.com/UDST/choicemodels/tree/master/tests) if possible!

- Open a pull request to the `UDST/choicemodels` master branch, including a writeup of your changes -- take a look at some of the closed PR's for examples

- Current maintainers will review the code, suggest changes, and hopefully merge it!


## Incrementing the version number:

- Each pull request that changes substantive code should increment the development version number, e.g. from 0.2.dev7 to 0.2.dev8

- It works best to do this just before merging (in case other PR's are merged first, and so you know the date for the changelog and documentation)

- There are three places where the version number needs to be changed: 
  - `setup.py`
  - `choicemodels/__init__.py`
  - `docs/source/index.rst`

- Please also add a section to `CHANGELOG.md` describing the changes!


### Updating the documentation: 

- See instructions in `docs/README.md`


{'fraction_non_alphanumeric': 0.0807855389422004, 'fraction_numerical': 0.005132782860968534, 'mean_word_length': 4.297872340425532, 'pattern_counts': {'":': 0, '<': 7, '<?xml version=': 0, '>': 7, 'https://': 10, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '7007999', 'n_tokens_mistral': 1279, 'n_tokens_neox': 1242, 'n_words': 584}