<commit_before>OpenTulsaDataTools
==================

Tools and Documentation for working with the Open Tulsa Datasets.

In May 2013, the Tulsa City Council and Mayor of Tulsa adopted the
[Open and Accessible Data Resolution](https://www.cityoftulsa.org/media/353986/resolution.pdf),
with direction to provide more data online and work toward a higher
level of transparency.

In January 2014, the City of Tulsa launched
[Open Tulsa](https://www.cityoftulsa.org/our-city/open-tulsa/about-open-tulsa.aspx),
a portal for highlighting published datasets and encouraging the release of
new open data sets.  They are also
[requesting feedback](https://www.cityoftulsa.org/our-city/open-tulsa/suggest-dataset.aspx)
on the site and other datasets that citizens would like to see.

This repository is for documenting the
[published datasets](https://www.cityoftulsa.org/our-city/open-tulsa/open-tulsa-dataset-list.aspx),
and providing sample software for working with the datasets.
<commit_msg>Add link to wiki.  Code will come later.<commit_after>OpenTulsaDataTools
==================

Tools and Documentation for working with the Open Tulsa Datasets.

In May 2013, the Tulsa City Council and Mayor of Tulsa adopted the
[Open and Accessible Data Resolution](https://www.cityoftulsa.org/media/353986/resolution.pdf),
with direction to provide more data online and work toward a higher
level of transparency.

In January 2014, the City of Tulsa launched
[Open Tulsa](https://www.cityoftulsa.org/our-city/open-tulsa/about-open-tulsa.aspx),
a portal for highlighting published datasets and encouraging the release of
new open data sets.  They are also
[requesting feedback](https://www.cityoftulsa.org/our-city/open-tulsa/suggest-dataset.aspx)
on the site and other datasets that citizens would like to see.

Eventually, this repository will include tools and sample code for working with the
[published datasets](https://www.cityoftulsa.org/our-city/open-tulsa/open-tulsa-dataset-list.aspx).
However, the immediate need is to document how to work with the data - we're using the
[wiki](https://github.com/codefortulsa/OpenTulsaDataTools/wiki)
to document what we figure out.

{'fraction_non_alphanumeric': 0.0956561922365989, 'fraction_numerical': 0.012939001848428836, 'mean_word_length': 5.064425770308123, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 9, 'lorem ipsum': 0, 'www.': 8, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5776086', 'n_tokens_mistral': 661, 'n_tokens_neox': 609, 'n_words': 234}