<commit_before># :shipit: Next

## Installation

```
gem 'shipit-engine'
```

```
bundle install
```


## Setup

```shell
$ git clone <EMAIL>:Shopify/shipit-engine.git
$ cd shipit-engine
$ script/bootstrap
```

## Local Development/Testing

- Create a **public** github repository like https://github.com/byroot/junk that
  contains a similar dummy `shipit.yml` file.
- Create an API key (https://github.com/settings/tokens/new) that has only
  public_repo permissions (Shipit doesn't need anything else) and add it in
  `config/secrets.yml` under `development.github_credentials.access_token`. Be
  careful with this key, it would give an attacker some permissions with your
  github account!
- Create a stack in your local Shipit that points to that repository.
- Make sure you have resque running (see below) in order for background jobs to
  work.

## Jobs

```shell
# run workers for deploy jobs
QUEUE=* bundle exec rake resque:work

# start-stop resque-web
resque-web
resque-web -K
```
<commit_msg>The Job section in the README is pretty much irrelevent now<commit_after># :shipit: Next

## Installation

```
gem 'shipit-engine'
```

```
bundle install
```


## Setup

```shell
$ git clone <EMAIL>:Shopify/shipit-engine.git
$ cd shipit-engine
$ script/bootstrap
```

## Local Development/Testing

- Create a **public** github repository like https://github.com/byroot/junk that
  contains a similar dummy `shipit.yml` file.
- Create an API key (https://github.com/settings/tokens/new) that has only
  public_repo permissions (Shipit doesn't need anything else) and add it in
  `config/secrets.yml` under `development.github_credentials.access_token`. Be
  careful with this key, it would give an attacker some permissions with your
  github account!
- Create a stack in your local Shipit that points to that repository.
- Make sure you have resque running (see below) in order for background jobs to
  work.
{'fraction_non_alphanumeric': 0.10350235232618923, 'fraction_numerical': 0.0, 'mean_word_length': 4.243835616438356, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 5, 'https://': 4, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1709224', 'n_tokens_mistral': 596, 'n_tokens_neox': 566, 'n_words': 221}