<commit_before># daliuge-base Docker Image

The DALiuGE base image contains common code for both the translator and also the DALiuGE execution engine. It is build and distributed as an image called *icrar/daliuge-base:latest*.

## Building the image

Pre-requisite for building and running the docker image is to have docker running on the host. The translator image is dependent on the icrar/daliuge-base image. If that is not available locally it will be installed from the ICRAR dockerHub repository.

To build the base image run the script

```bash
./build_base.sh
```

## Using the daliuge-base image

The daliuge-base image is not meant to be used stand-alone.
<commit_msg>changed base to common<commit_after># daliuge-base Docker Image

The DALiuGE base image contains common code for both the translator and also the DALiuGE execution engine. It is build and distributed as an image called *icrar/daliuge-base:latest*.

## Building the image

Pre-requisite for building and running the docker image is to have docker running on the host. The translator image is dependent on the icrar/daliuge-base image. If that is not available locally it will be installed from the ICRAR dockerHub repository.

To build the base image run the script

```bash
./build_common.sh
```

## Using the daliuge-base image

The daliuge-base image is not meant to be used stand-alone.

{'fraction_non_alphanumeric': 0.05113221329437546, 'fraction_numerical': 0.0, 'mean_word_length': 4.3515625, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '7285793', 'n_tokens_mistral': 386, 'n_tokens_neox': 365, 'n_words': 199}