<commit_before># Testing with Docker

Before running the tests with docker, you'll need Docker installed and the docker image downloaded.

## Install docker

```shell
$ sudo apt install docker.io && sudo usermod -aG docker $(whoami)
```

## Download image

```shell
docker pull carto/IMAGE
```

## Carto account

* `https://hub.docker.com/r/carto/`

## Update image

* Edit the docker image file with your desired changes
* Build image:
  * `docker build -t carto/IMAGE -f docker/DOCKER_FILE docker/`

* Upload to docker hub:
  * Login into docker hub:
    * `docker login`
  * Create tag:
    * `docker tag carto/IMAGE carto/IMAGE`
  * Upload:
    * `docker push carto/IMAGE`
<commit_msg>Update doc<commit_after># Testing with Docker

Before running the tests with docker, you'll need Docker installed and the docker image downloaded.

## Install docker

```shell
$ sudo apt install docker.io && sudo usermod -aG docker $(whoami)
```

## Download image

```shell
docker pull carto/IMAGE
```

## Carto account

* `https://hub.docker.com/r/carto/`

## Update image

* Edit the docker image file
* Build image:
  * `docker build -t carto/IMAGE -f docker/DOCKER_FILE docker/`

* Upload to docker hub:
  * Login into docker hub:
    * `docker login`
  * Create tag:
    * `docker tag carto/IMAGE carto/IMAGE`
  * Upload:
    * `docker push carto/IMAGE`

{'fraction_non_alphanumeric': 0.1156412157153447, 'fraction_numerical': 0.0, 'mean_word_length': 3.5918367346938775, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 2, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 4, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6468474', 'n_tokens_mistral': 480, 'n_tokens_neox': 427, 'n_words': 157}