<commit_before>OSM History Analysis Tool
=========================

[Project EPIC](http://epic.cs.colorado.edu) 2014.

##About




##Development Questions
A running tally of questions that we have as we develop

1. Database Connection
	-	Currently we mocked the database to connect to the existing Mongo instance for Haiti and return a simple hash called "database".  The question is whether to use a tool like Mongoid or MongoMapper to link our classes directly to the Mongo Instance, or whether we should write our own wrapper since our queries will be relatively simple from the Mongo standpoint.
		- However if we have a Containers or Bounding Box collection, we would probably want to interact with it in such a way (i.e. have the ability to save / update.)
		
2. How should we handle Geo Objects?  Should the domain object itself inherit from RGeo?  Should we use RGeo? yes.
3. What is best practice: super(args) vs. post_initialize?



##Development Questions: October 5, 2014

1. Finalize version 1 questions and then refactor the code.

2. Running new import script on server (and to create local offline copies)


###V1 Questions:
1. Top contributors (per analysis window)
	a. 	What's the metric here?  nodes, changesets, what makes an active user?

2. Recent edits
	a. Again, what's the metric? Nodes, changesets, etc?
	b. Returns geometries for visualization

3. POI count
	a. What defines a point of interest.
	b. Weekly/Monthly buckets

4. Length of Ways
	a. Rivers, roads, etc.
	b. Weekly/Monthly buckets

5. Building Count
	a. Especially tasks which
	b. Weekly/Monthly buckets


###Refactor Process
1. Implement MongoMapper
2. Run clean, fresh imports of OSM data in decided "best practice" DB format
3. Pull appropriate pieces out of Analysis Window


###Database Structure Questions
1. Should we define a unique compound key on id + version ? <-- this could be a post processing piece<commit_msg>brief updates to readme<commit_after>OSM History Analysis Tool
=========================

[Project EPIC](http://epic.cs.colorado.edu) 2014.

##About




##Development Questions
A running tally of questions that we have as we develop

1. Database Connection
	-	Currently we mocked the database to connect to the existing Mongo instance for Haiti and return a simple hash called "database".  The question is whether to use a tool like Mongoid or MongoMapper to link our classes directly to the Mongo Instance, or whether we should write our own wrapper since our queries will be relatively simple from the Mongo standpoint.
		- However if we have a Containers or Bounding Box collection, we would probably want to interact with it in such a way (i.e. have the ability to save / update.)
		
2. How should we handle Geo Objects?  Should the domain object itself inherit from RGeo?  Should we use RGeo? yes.
3. What is best practice: super(args) vs. post_initialize?



##Development Questions: October 5, 2014

1. Finalize version 1 questions and then refactor the code.

2. Running new import script on server (and to create local offline copies)


###V1 Questions:
1. Top contributors (per analysis window)
	a. 	What's the metric here?  nodes, changesets, what makes an active user?
DONE (At least for changesets)

2. Recent edits
	a. Again, what's the metric? Nodes, changesets, etc?
	b. Returns geometries for visualization

3. POI count
	a. What defines a point of interest.
	b. Weekly/Monthly buckets

4. Length of Ways
	a. Rivers, roads, etc.
	b. Weekly/Monthly buckets

5. Building Count
	a. Especially tasks which
	b. Weekly/Monthly buckets

6. Within temporally adjacent / overlapping changesets, identify users that worked in close geographic proximity


###Refactor Process
1. Implement MongoMapper
2. Run clean, fresh imports of OSM data in decided "best practice" DB format
3. Pull appropriate pieces out of Analysis Window


###Database Structure Questions
1. Should we define a unique compound key on id + version ? <-- this could be a post processing piece
{'fraction_non_alphanumeric': 0.06854130052724078, 'fraction_numerical': 0.012804418779814211, 'mean_word_length': 4.023959646910466, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 4, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2691702', 'n_tokens_mistral': 1139, 'n_tokens_neox': 1027, 'n_words': 597}