<commit_before># Bucket Scanner

[![pipeline status](https://gitlab.com/cjbarker/bucketscanner/badges/master/pipeline.svg)](https://gitlab.com/cjbarker/bucketscanner/commits/master)  [![coverage report](https://gitlab.com/cjbarker/bucketscanner/badges/master/coverage.svg)](http://cjbarker.pages.gitlab.com/bucketscanner/test-coverage.html)

## Overview
*Searching Cloud Storage Since 2017*

## Usage
TBA

## Developer
Bucket Scanner supports multiple platform builds via GNU Make. 

To build clone the repo, setup Go and run make.

The default make target builds the library and command line binary in the same directory: bucketscanner and libbucketscanner.

```
git clone <EMAIL>:cjbarker/bucketscanner.git
cd bucketscanner
export GOPATH=${GOPATH}:`pwd`
make
```

Bucketscanner supports multiple platform builds via GNU Make. It does assume and rely on
[Glide](https://github.com/Masterminds/glide) for GoLang package management including dependencies.  Please ensure glide is installed and available in your path before continuing.

To build the binary and library you'll need to clone the repo, setup GoLang and run make.

The default make target builds both components command line binary and library (bucketscanner and libbucketscanner).

```
# Assumes GOPATH exists and golang installed with tools in path
# export PATH=${GOPATH}/bin:${PATH}

cd ${GOPATH}/src
mkdir -p gitlab.com/cjbarker/
cd gitlab.com/cjbarker
git clone <EMAIL>:cjbarker/bucketscanner.git
cd bucketscanner
make

# Built Binary & Library<commit_msg>Removed extraenous info<commit_after># Bucket Scanner

[![pipeline status](https://gitlab.com/cjbarker/bucketscanner/badges/master/pipeline.svg)](https://gitlab.com/cjbarker/bucketscanner/commits/master)  [![coverage report](https://gitlab.com/cjbarker/bucketscanner/badges/master/coverage.svg)](http://cjbarker.pages.gitlab.com/bucketscanner/test-coverage.html)

## Overview
*Searching Cloud Storage Since 2017*

## Usage
TBA

## Developer
Bucketscanner supports multiple platform builds via GNU Make. It does assume and rely on
[Glide](https://github.com/Masterminds/glide) for GoLang package management including dependencies.  Please ensure glide is installed and available in your path before continuing.

To build the binary and library you'll need to clone the repo, setup GoLang and run make.

The default make target builds both components command line binary and library (bucketscanner and libbucketscanner).

```
# Assumes GOPATH exists and golang installed with tools in path
# export PATH=${GOPATH}/bin:${PATH}

cd ${GOPATH}/src
mkdir -p gitlab.com/cjbarker/
cd gitlab.com/cjbarker
git clone <EMAIL>:cjbarker/bucketscanner.git
cd bucketscanner
make

# Built Binary & Library
{'fraction_non_alphanumeric': 0.09553670232386573, 'fraction_numerical': 0.002950940612320177, 'mean_word_length': 5.42654028436019, 'pattern_counts': {'":': 0, '<': 6, '<?xml version=': 0, '>': 6, 'https://': 8, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1932476', 'n_tokens_mistral': 853, 'n_tokens_neox': 792, 'n_words': 264}