<commit_before>TFC MAP
=======

## Feature list
### Client
* store user preferences (basemap/layers on)
* make use of config as much as possible
* possiblity to have many maps generated from different geojson based data sets
* backend should be able to push updates
* default layer, on by default layers

### Server
* possibility to send updates to the client
* adaptors for feeds to node service which can then diff for changes and send server sent events (sse's) to connected clients

## Config details

### Map
```json
{
    "tileLayers": [
        {
            "name": "Default",
            "url": "http://...",
            "time": {
                "on": "8:00",
                "off": "11:00"
            }
        }
    ]
}
```

### Layers
```json
[
    {
        "name": "Major Roadworks",
        "styles": {
            //get design inputs, likely design of a popup etc.
            //title, description and a table of data?
            "h1": "#f3f3f3"
        },
        "priority": 1,
        "icon": "",
        "visiblebByDefault": true,
        "zoom": [
            {
                "min": 4,
                "max": 16,
                "type": "heatmap"
            },
            {
                "min": 4,
                "max": 16,
                "type": "cluster"
            }
        ],
        "refresh": false || {
            "type": "longPoll", //could be sse
            "time": 10000
        },
        "postProcess": {
            "laneSplit": true
        }
    }
]
```<commit_msg>update README to match new expectations<commit_after>TFC MAP
=======

## Feature list
### Client
* store user preferences (basemap/layers on)
* make use of config as much as possible
* possiblity to have many maps generated from different geojson based data sets
* backend should be able to push updates
* default layer, on by default layers

### Server
* possibility to send updates to the client
* adaptors for feeds to node service which can then diff for changes and send server sent events (sse's) to connected clients

## Config details

### Map
```json
{
    "tileLayers": [
        {
            "name": "Default",
            "url": "http://...",
            "time": {
                "on": "8:00",
                "off": "11:00"
            }
        }
    ]
}
```

### Layers
```json
[
    {
        "name": "Major Roadworks",
        "styles": {
            //get design inputs, likely design of a popup etc.
            //title, description and a table of data?
            "h1": "#f3f3f3"
        },
        "priority": 1,
        "icon": "",
        "visiblebByDefault": true,
        "zoom": [
            {
                "min": 4,
                "max": 16,
                "type": "heatmap"
            },
            {
                "min": 4,
                "max": 16,
                "type": "cluster"
            }
        ],
        "dataSource": {
            "url": "...",
            "type": "longPoll",
            "refresh": 10000
        }
        "postProcess": {
            "laneSplit": true
        }
    }
]
```
{'fraction_non_alphanumeric': 0.13507340946166393, 'fraction_numerical': 0.01500815660685155, 'mean_word_length': 1.4294770206022187, 'pattern_counts': {'":': 49, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1808291', 'n_tokens_mistral': 921, 'n_tokens_neox': 848, 'n_words': 282}