<commit_before>===========
GatherNews
===========

Gathers unstructured News data and commits it to a SQLite3 database.

News is valuable when it contains actionable information. Collecting the news
for text analytics should be easy; even if the news is unstructured data. The
goal for GatherNews is to quickly and simply gather News data. We want to
know who, what, when, where, why, and how. We want it in a SQL database.

GatherNews allows you to specify which News sites you want to capture by
providing the RSS link in "feeds_list.txt" like this:

    http://feeds.reuters.com/Reuters/worldNews
    
    http://rss.cnn.com/rss/money_latest.rss

You can then gather the news using these methods:<commit_msg>minor<commit_after>===========
GatherNews
===========

Gathers unstructured News data and commits it to a SQLite3 database.

News is valuable when it contains actionable information. Collecting the news
for text analytics should be easy; even if the news is unstructured data. The
goal for GatherNews is to quickly and simply gather News data. We want to
know who, what, when, where, why, and how. We want it in a SQL database.

GatherNews allows you to specify which News sites you want to capture by
providing the RSS link in "feeds_list.txt" like this:

    http://feeds.reuters.com/Reuters/worldNews
    http://rss.cnn.com/rss/money_latest.rss

You can then gather the news using these methods:
{'fraction_non_alphanumeric': 0.08090844570617459, 'fraction_numerical': 0.0014194464158978, 'mean_word_length': 4.222222222222222, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '850064', 'n_tokens_mistral': 406, 'n_tokens_neox': 380, 'n_words': 197}