<commit_before>Package s3gof3r provides fast, concurrent, streaming access to Amazon S3. Includes a command-line interface.

 Command-line Interface Usage:

 ```
   To stream up to S3:
      $  <input_stream> | gof3r put -b <bucket> -k <s3_path>
   To stream down from S3:
      $ gof3r get -b <bucket> -k <s3_path> | <output_stream>
   To upload a file to S3:
      $ gof3r  put --path=<local_path> --bucket=<bucket> --key=<s3_path> --header=<http_header1> --header=<http_header2>...
   To download a file from S3:
      $ gof3r  get --bucket=<bucket> --key=<s3_path>
```

 Set AWS keys as environment Variables (required):

```
  $ export AWS_ACCESS_KEY_ID=<access_key>
  $ export AWS_SECRET_ACCESS_KEY=<secret_key>
```

 Examples:

  ```
  $ tar -cf - /foo_dir/ | gof3r put -b my_s3_bucket -k bar_dir/s3_object -m x-amz-meta-custom-metadata:abc123 -m x-amz-server-side-encryption:AES256
  $ gof3r get -b my_s3_bucket -k bar_dir/s3_object | tar -x
  ```
 Complete Usage: get command:

 ```
   gof3r [OPTIONS] get [get-OPTIONS]

   get (download) from S3
<commit_msg>Add links to compiled binaries for testing.<commit_after>Package s3gof3r provides fast, concurrent, streaming access to Amazon S3. Includes a command-line interface.

 Command-line Interface Usage:

 ```
   To stream up to S3:
      $  <input_stream> | gof3r put -b <bucket> -k <s3_path>
   To stream down from S3:
      $ gof3r get -b <bucket> -k <s3_path> | <output_stream>
   To upload a file to S3:
      $ gof3r  put --path=<local_path> --bucket=<bucket> --key=<s3_path> --header=<http_header1> --header=<http_header2>...
   To download a file from S3:
      $ gof3r  get --bucket=<bucket> --key=<s3_path>
```

 Set AWS keys as environment Variables (required):

```
  $ export AWS_ACCESS_KEY_ID=<access_key>
  $ export AWS_SECRET_ACCESS_KEY=<secret_key>
```

**Try the gof3r command-line tool with statically-linked binaries**  
[linux amd/64 binary (go1.2)](https://dl.dropboxusercontent.com/u/30064071/s3gof3r/linux/gof3r)  
[mac osx binary (go1.2)](https://dl.dropboxusercontent.com/u/30064071/s3gof3r/osx/gof3r)   

 Examples:

  ```
  $ tar -cf - /foo_dir/ | gof3r put -b my_s3_bucket -k bar_dir/s3_object -m x-amz-meta-custom-metadata:abc123 -m x-amz-server-side-encryption:AES256
  $ gof3r get -b my_s3_bucket -k bar_dir/s3_object | tar -x
  ```
 Complete Usage: get command:

 ```
   gof3r [OPTIONS] get [get-OPTIONS]

   get (download) from S3

{'fraction_non_alphanumeric': 0.13514627111660485, 'fraction_numerical': 0.03749484960857025, 'mean_word_length': 3.422586520947177, 'pattern_counts': {'":': 0, '<': 33, '<?xml version=': 0, '>': 33, 'https://': 2, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 4, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5052994', 'n_tokens_mistral': 988, 'n_tokens_neox': 938, 'n_words': 240}