<commit_before># Beer
Tools to generate a portable database of brewery information.

# What does this do?
These scripts will pull data from brewersassociation.org for every brewery in
a given state, and format it into a CSV that is suitable for general use.

# Why does this exist?
I was going on a road trip and wanted to visit some breweries. I located a
source of data, and whipped up this code to scrape it and get it into a format
I could import into Google Maps. Also, because beer.

# Usage
For one state: `./beer.sh "New York"`

For all states: `./all.sh`

# Data
The script will create a file `./archive/New York/YYYYMMDD.csv` with current
data from the brewery search function on brewersassociation.org. If any
previous CSV files for the given state exist, you'll also get a diff from
the most recent version.

The `./db` subdirectory contains manually edited tweaks to the CSV files
generated by the script. These are updated with fixed website URLs, phone
numbers, etc. The files in this directory, when available, should be
preferred over the raw files in `./archive`.
<commit_msg>Updated to reflect previous file name changes.<commit_after># Beer
Tools to generate a portable database of brewery information.

# What does this do?
These scripts will pull data from brewersassociation.org for every brewery in
a given state, and format it into a CSV that is suitable for general use.

# Why does this exist?
I was going on a road trip and wanted to visit some breweries. I located a
source of data, and whipped up this code to scrape it and get it into a format
I could import into Google Maps. Also, because beer.

# Usage
For one state: `./beer.sh "New York"`

For all states: `./all.sh`

# Data
The script will create a file `./archive/New_York/New_York_YYYYMMDD.csv` with
current data from the brewery search function on brewersassociation.org. If
any previous CSV files for the given state exist, you'll also get a diff from
the most recent version.

The `./db` subdirectory contains manually edited tweaks to the CSV files
generated by the script. These are updated with fixed website URLs, phone
numbers, etc. The files in this directory, when available, should be
preferred over the raw files in `./archive`.

{'fraction_non_alphanumeric': 0.054260089686098655, 'fraction_numerical': 0.0, 'mean_word_length': 4.105263157894737, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '692745', 'n_tokens_mistral': 610, 'n_tokens_neox': 581, 'n_words': 361}