<commit_before>Lana Project
============

Collect and analyze the tweets. Idea and code from [Greg Moreno]
(http://gregmoreno.wordpress.com/2012/09/05/mining-twitter-data-with-ruby-mongodb-and-map-reduce/) [Part 1]
(http://gregmoreno.wordpress.com/2012/09/20/mining-twitter-data-with-ruby-visualizing-user-mentions/) [Part 2]

```
  # adjust settings in config/*.yml
  ruby lib/collect.rb   # leave this running to collect tweets to mongodb
  ruby lib/counter.rb   # show stats for user tweet counts
  ruby lib/mentions.rb  # show stats for user tweet mentions in graph.dot

  neato -Tpng graph.dot -o mentions.png  # convert dot to png file<commit_msg>Some minor changes<commit_after>Lana Project
============

Collect and analyze the tweets. Idea and code from <NAME>
[Part 1] (http://gregmoreno.wordpress.com/2012/09/05/mining-twitter-data-with-ruby-mongodb-and-map-reduce/) 
[Part 2] (http://gregmoreno.wordpress.com/2012/09/20/mining-twitter-data-with-ruby-visualizing-user-mentions/)

```
  # adjust settings in config/*.yml
  ruby lib/collect.rb   # leave this running to collect tweets to mongodb
  ruby lib/counter.rb   # show stats for user tweet counts
  ruby lib/mentions.rb  # show stats for user tweet mentions in graph.dot

  neato -Tpng graph.dot -o mentions.png  # convert dot to png file
{'fraction_non_alphanumeric': 0.12720306513409962, 'fraction_numerical': 0.027586206896551724, 'mean_word_length': 3.8550185873605947, 'pattern_counts': {'":': 0, '<': 4, '<?xml version=': 0, '>': 4, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2156098', 'n_tokens_mistral': 477, 'n_tokens_neox': 407, 'n_words': 122}