<commit_before>
### Using dynamite with docker

To build the docker image, in the root directory of the dynamite git repository run:

```
docker build --build-arg GIT_BRANCH=(git rev-parse --abbrev-ref HEAD) --build-arg GIT_COMMIT=(git describe --always) -t gdmeyer/dynamite:0.1.0-jupyter -f docker/Dockerfile-cpu .
```

To build an image without jupyter, run
```
docker build --target=build --build-arg GIT_BRANCH=(git rev-parse --abbrev-ref HEAD) --build-arg GIT_COMMIT=(git describe --always) -t gdmeyer/dynamite:0.1.0-jupyter -f docker/Dockerfile-cpu .
```

To run a Python script in the current directory with dynamite, do:

```
docker run -it --rm -v "$PWD":/home/dnm/src gdmeyer/dynamite:0.1.0 python your_script.py
```

For example, to run the unit tests in the docker container, you can do

```
cd tests/unit/
docker run -it --rm -v "$PWD":/home/dnm/src gdmeyer/dynamite:0.1.0 python -m unittest discover .
```<commit_msg>update docker README.md<commit_after>
### Building dynamite for Docker

To build the generic dynamite image, in the root directory of the dynamite git repository run:

```
docker build --build-arg HARDWARE=cpu -f docker/Dockerfile --target release -t gdmeyer/dynamite:latest .
```

For the Jupyter version, just change the target to ``jupyter``, and to include GPU support change HARDWARE to "gpu".

To build all relevant images (with and without Jupyter, and cpu/gpu), and with a clean checkout of the git (to avoid including any extraneous files), you can also just run the script ``build.py`` in this directory.
{'fraction_non_alphanumeric': 0.11715210355987055, 'fraction_numerical': 0.007766990291262136, 'mean_word_length': 4.0855263157894735, 'pattern_counts': {'":': 2, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6110156', 'n_tokens_mistral': 535, 'n_tokens_neox': 506, 'n_words': 194}