<commit_before># Configuration

JLineup has many configuration options. A JLineup cycle with it's _before_ and _after_ steps is called _job_ throughout
this documentation. Job configuration settings can be separated between two scopes, _global_ and _site_. Some of the
options exist in global as in site scope for convenience.

Site specific settings always have precedence before global settings.

### Format

A JLineup job config is a json document. 

For JLineup CLI, the default name of the config file is ___lineup.json___.
It's searched in the current working directory. A different path can be specified with the
`--config` option.

If using the web server variant, you have to POST the config via REST API.

### Basic config

A basic configuration with default settings can look like this:

```json
{
  "urls": {
    "https://www.otto.de": {
    }
  }<commit_msg>Update CONFIGURATION.md<commit_after># Configuration

JLineup has many configuration options. A JLineup cycle with it's _before_ and _after_ steps is called _job_ throughout
this documentation. Job configuration settings can be separated between two scopes, _global_ and _site_. Some of the
options exist in global as in site scope for convenience.

Site specific settings always have precedence before global settings.

### Format

A JLineup job config is a JSON document. Additionally to JSON standard, JLineup can work with line or multiline comments in it's config. `// comment` or `/* comment */` are ok. Also ok are [trailing commas](https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Trailing_commas).

For JLineup CLI, the default name of the config file is ___lineup.json___.
It's searched in the current working directory. A different path can be specified with the
`--config` option.

If using the web server variant, you have to POST the config via REST API.

### Basic config

A basic configuration with default settings can look like this:

```json
{
  "urls": {
    "https://www.otto.de": {
    }
  }
{'fraction_non_alphanumeric': 0.06596701649175413, 'fraction_numerical': 0.0, 'mean_word_length': 4.186528497409326, 'pattern_counts': {'":': 4, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 3, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '4699925', 'n_tokens_mistral': 541, 'n_tokens_neox': 521, 'n_words': 274}