<commit_before>Grants.gov Keyword Search Helper
================================

It was brought to my attention by a good friend that the search facilities on Grants.gov are not so good. 
The keyword search always ORs your keywords together, even if you use AND or try to quote a phrase. 
On top of that it doesn't give the same count of results even if you run the exact same search 2 minutes apart.

So this is a little HTML scraper to suck down the results for a keyword search on Grants.gov into a CSV (Comma Separated Values) file. (CSV files are readable by the vast majority of spreadsheet and database programs.)

Installation
------------

1. Install Ruby, if you don't have it already. This tool was developed on Ruby 1.9.2.

  - Windows: 
    + Use the RubyInstaller: http://rubyinstaller.org/downloads/
    + Choose the 1.9.x installer, currently 1.9.2-p180.
    + Run the installer, turning ON the check boxes to have the installer add ruby to your path and to associate the files with ruby.

  - Additional Ruby Install Options, including Mac & Linux: http://www.ruby-lang.org/en/downloads/
  
  - Type `ruby --version` at the command line to verify that it has installed.

2. Download this project: 

  - Go to https://github.com/laripk/grantsgov_keywordsearch_helper<commit_msg>futzing with markdown in README<commit_after>Grants.gov Keyword Search Helper
================================

It was brought to my attention by a good friend that the search facilities on Grants.gov are not so good. 
The keyword search always ORs your keywords together, even if you use AND or try to quote a phrase. 
On top of that it doesn't give the same count of results even if you run the exact same search 2 minutes apart.

So this is a little HTML scraper to suck down the results for a keyword search on Grants.gov into a CSV (Comma Separated Values) file. (CSV files are readable by the vast majority of spreadsheet and database programs.)

Installation
------------

1. Install Ruby, if you don't have it already. This tool was developed on Ruby 1.9.2.

  - Windows: 
    1. Use the RubyInstaller: http://rubyinstaller.org/downloads/
    2. Choose the 1.9.x installer, currently 1.9.2-p180.
    3. Run the installer, turning ON the check boxes to have the installer add ruby to your path and to associate the files with ruby.

  - Additional Ruby Install Options, including Mac & Linux: http://www.ruby-lang.org/en/downloads/
  
  - Type `ruby --version` at the command line to verify that it has installed.

2. Download this project: 

  - Go to https://github.com/laripk/grantsgov_keywordsearch_helper
{'fraction_non_alphanumeric': 0.08962083492914592, 'fraction_numerical': 0.011872845653006512, 'mean_word_length': 3.503448275862069, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 2, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 6, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1609486', 'n_tokens_mistral': 742, 'n_tokens_neox': 689, 'n_words': 374}