<commit_before>SDETool2
=======

[![GoDoc](https://godoc.org/github.com/THUNDERGROOVE/SDETool2?status.png)](https://godoc.org/github.com/THUNDERGROOVE/SDETool2)

SDETool2 uses the Dust514 Static Data Export to poll for info.

Building
========
You need [Go](http://golang.org) with your GOPATH environment variable setup with our dependencies

On Windows you will need GCC which you can usually get from either [Cygwin](http://www.cygwin.com/) or [Mingw](http://www.mingw.org/)  I use Mingw so that's your best bet.  It must match the CPU architecture as what you're building for.

In Linux you'll need build-essentials.  Installing it can depend on your distro however you should be able to figure this out if you need.
``` bash
make deps<commit_msg>readme update<commit_after>SDETool2
=======

[![GoDoc](https://godoc.org/github.com/THUNDERGROOVE/SDETool2?status.png)](https://godoc.org/github.com/THUNDERGROOVE/SDETool2)

SDETool2 uses the Dust514 Static Data Export to poll for info.

Building
========
When SDETool2 becomes more useful I will provide precompiled binaries for Windows.

You need [Go](http://golang.org) with your GOPATH environment variable setup with our dependencies

On Windows you will need GCC which you can usually get from either [Cygwin](http://www.cygwin.com/) or [Mingw](http://www.mingw.org/)  I use Mingw so that's your best bet.  It must match the CPU architecture as what you're building for.

In Linux you'll need build-essentials.  Installing it can depend on your distro however you should be able to figure this out if you need.
``` bash
make deps
{'fraction_non_alphanumeric': 0.10781841109709962, 'fraction_numerical': 0.009457755359394703, 'mean_word_length': 4.667857142857143, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 4, 'lorem ipsum': 0, 'www.': 4, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '279483', 'n_tokens_mistral': 518, 'n_tokens_neox': 479, 'n_words': 188}