<commit_before>OpenStreetMap Hall Monitor
==========================

This module is a passive changeset monitoring tool for use with OpenStreetMap.

To begin use, simply call `import osmhm` after installation.

Sample calls available for now:

```
import osmhm

data = osmhm.fetchThis('25866')  # Retrieves the 000/025/866 diff
differenceObject = osmhm.diffUtil(data)  # Parse the data stream
changesets, users, objects = osmhm.process(differenceObject) # Process the data

userInfo = {}
for changeset in changesets.iteritems():
    userInfo[changeset] = osmhm.userUtil(changeset['uid'])  # Retrieves user information 

```

More information will be coming soon and the tool will continue to be improved, including the option to remove the dependency on psycopg2 and a postgres database to store everything.

If you are interested in helping with development and want to discuss things "big picture", please [contact me](mailto:<EMAIL>).<commit_msg>Updated README with new extraction calls<commit_after>OpenStreetMap Hall Monitor
==========================

This module is a passive changeset monitoring tool for use with OpenStreetMap.

To begin use, simply call `import osmhm` after installation.

Sample calls available for now:

```
import osmhm

data = osmhm.fetchThis('25866')  # Retrieves the 000/025/866 diff
differenceObject = osmhm.diffUtil(data)  # Parse the data stream
changesets = osmhm.extract_changesets(differenceObject) # Extract changeset information
users = osmhm.extract_users(differenceObject) # Extract user information
objects = osmhm.extract_objects(differenceObject) # Extract object information

userInfo = {}
for changeset in changesets.iteritems():
    userInfo[changeset] = osmhm.userUtil(changeset['uid'])  # Retrieves user information 

```

More information will be coming soon and the tool will continue to be improved, including the option to remove the dependency on psycopg2 and a postgres database to store everything.

If you are interested in helping with development and want to discuss things "big picture", please [contact me](mailto:<EMAIL>).
{'fraction_non_alphanumeric': 0.09295639674173455, 'fraction_numerical': 0.014374700527072353, 'mean_word_length': 5.6075949367088604, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 5, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6551661', 'n_tokens_mistral': 591, 'n_tokens_neox': 526, 'n_words': 228}