<commit_before># Digraph

Keep track of links in a mind-map like network of topics.

* Public site [here](https://digraph.app)
* Recent updates are covered [here](https://blog.digraph.app)
* Some of the use cases that are contemplated are described [here](https://github.com/emwalker/digraph/wiki)

## Technical details

* GraphQL backend written in Golang
* Postgres
* React/Relay client
* Webpack 4
* [volatiletech/sqlboiler](https://github.com/volatiletech/sqlboiler)
* [99designs/gqlgen](https://github.com/99designs/gqlgen)
* [GitHub Primer](https://styleguide.github.com/primer/) CSS

## Getting started

Requirements

* Postgres 10
* Redis 5
* Go 1.11
* yarn

Set up the project:
```
$ mkdir $GOPATH/src/github.com/emwalker
$ cd $GOPATH/src/github.com/emwalker
$ git clone <EMAIL>:emwalker/digraph.git
$ cd digraph
$ make load-fixtures
$ go get -u github.com/99designs/gqlgen
$ make generate
$ go get -u ./...
$ yarn install
```

Run the tests:
```
$ make test
$ make test-integration
```

Run the app in development:
```
$ make start
```<commit_msg>Add a missing step to README<commit_after># Digraph

Keep track of links in a mind-map like network of topics.

* Public site [here](https://digraph.app)
* Recent updates are covered [here](https://blog.digraph.app)
* Some of the use cases that are contemplated are described [here](https://github.com/emwalker/digraph/wiki)

## Technical details

* GraphQL backend written in Golang
* Postgres
* React/Relay client
* Webpack 4
* [volatiletech/sqlboiler](https://github.com/volatiletech/sqlboiler)
* [99designs/gqlgen](https://github.com/99designs/gqlgen)
* [GitHub Primer](https://styleguide.github.com/primer/) CSS

## Getting started

Requirements

* Postgres 10
* Redis 5
* Go 1.11
* yarn

Set up the project:
```
$ mkdir $GOPATH/src/github.com/emwalker
$ cd $GOPATH/src/github.com/emwalker
$ git clone <EMAIL>:emwalker/digraph.git
$ cd digraph
$ make load-fixtures
$ go get -u github.com/99designs/gqlgen
$ make generate
$ go get -u ./...
$ yarn install
$ yarn relay
```

Run the tests:
```
$ make test
$ make test-integration
```

Run the app in development:
```
$ make start
```
{'fraction_non_alphanumeric': 0.1377217553688142, 'fraction_numerical': 0.012138188608776844, 'mean_word_length': 4.23960880195599, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 5, 'https://': 12, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '391126', 'n_tokens_mistral': 784, 'n_tokens_neox': 728, 'n_words': 205}