<commit_before># hkpg

Automated archiving of Heroku Postgres backups written in Go

Inspired by https://github.com/kbaum/heroku-database-backups

Deploy with ideas in https://stackoverflow.com/a/43265218/1949363

Manage deps / deploys with: https://devcenter.heroku.com/articles/deploying-go

TODO:
* wrap log statements in HKPG_DEBUG check
* add a license
* add tests around core behavior

## Environment Variables

HEROKU_AUTH_TOKEN=""
HEROKU_APP_NAME=""
AWS_ACCESS_KEY_ID=""
AWS_SECRET_KEY=""
S3_BUCKET_NAME="" (optional, defaults to us-west-1)

## Configuring Heroku Scheduler

TODO

## Configuring S3 bucket permissions<commit_msg>Cleanup README on env vars<commit_after># hkpg
### Automated archiving of Heroku Postgres backups written in Go

Inspired by https://github.com/kbaum/heroku-database-backups

TODO:
* wrap log statements in HKPG_DEBUG check
* add a license
* add tests around core behavior

## Environment Variables

The below environment variables are required unless otherwise specified:

* HEROKU_AUTH_TOKEN="copy-from-heroku-dashboard"
* HEROKU_APP_NAME="my-app-name"
* AWS_ACCESS_KEY_ID="key-id"
* AWS_SECRET_KEY="secret-id"
* S3_BUCKET_NAME="your-bucket-name"
* AWS_REGION="us-east-1" (optional, defaults to us-west-1)

## Configuring Heroku Scheduler

Setup Heroku Scheduler to run `bin/backup`.

## Configuring S3 bucket permissions
{'fraction_non_alphanumeric': 0.09492273730684327, 'fraction_numerical': 0.016188373804267846, 'mean_word_length': 5.570048309178744, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 4, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1805215', 'n_tokens_mistral': 471, 'n_tokens_neox': 455, 'n_words': 124}