<commit_before># How to contribute

## First steps before starting

### Database setup

```sh
# you can either install postgis or use a docker instance directly:
docker run --name "batimap_pg" -p 25432:5432 -d -t kartoza/postgis

# download data from http://download.geofabrik.de/europe/, for instance:
wget http://download.geofabrik.de/europe/france/corse-latest.osm.pbf -O my-region.osm.pbf
# or for whole france (incl. overseas departments):
# osmium is in osmium-tool on Debian
wget http://download.geofabrik.de/europe/france-latest.osm.pbf http://download.geofabrik.de/europe/france/{guadeloupe,guyane,martinique,mayotte,reunion}-latest.osm.pbf
osmium merge *.pbf -o my-region.osm.pbf


# then filter data (osmconvert and osmfilter binaries are located in osmctools on Debian)
osmconvert -v my-region.osm.pbf -o=./my-region.o5m && \
osmfilter --keep="type=boundary and boundary=administrative" -v my-region.o5m -o=boundaries.o5m && \
osmconvert -v --out-pbf boundaries.o5m > boundaries.pbf

# WARNING: the following command will remove ALL database. Add '--append --slime' parameters
# if you wish to keep your data!
osm2pgsql -H localhost -U docker -P 25432 --verbose --proj 4326 --hstore-all -W --database gis boundaries.pbf
```<commit_msg>docs(backend): fix typo in doc<commit_after># How to contribute

## First steps before starting

### Database setup

```sh
# you can either install postgis or use a docker instance directly:
docker run --name "batimap_pg" -p 25432:5432 -d -t kartoza/postgis

# download data from http://download.geofabrik.de/europe/, for instance:
wget http://download.geofabrik.de/europe/france/corse-latest.osm.pbf -O my-region.osm.pbf
# or for whole france (incl. overseas departments):
# osmium is in osmium-tool on Debian
wget http://download.geofabrik.de/europe/france-latest.osm.pbf http://download.geofabrik.de/europe/france/{guadeloupe,guyane,martinique,mayotte,reunion}-latest.osm.pbf
osmium merge *-latest.osm.pbf -o my-region.osm.pbf


# then filter data (osmconvert and osmfilter binaries are located in osmctools on Debian)
osmconvert -v my-region.osm.pbf -o=./my-region.o5m && \
osmfilter --keep="type=boundary and boundary=administrative" -v my-region.o5m -o=boundaries.o5m && \
osmconvert -v --out-pbf boundaries.o5m > boundaries.pbf

# WARNING: the following command will remove ALL database. Add '--append --slim' parameters
# if you wish to keep your data!
osm2pgsql -H localhost -U docker -P 25432 --verbose --proj 4326 --hstore-all -W --database gis boundaries.pbf
```
{'fraction_non_alphanumeric': 0.12495041650138834, 'fraction_numerical': 0.01824672748909163, 'mean_word_length': 4.157464212678937, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 5, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 10, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5781973', 'n_tokens_mistral': 940, 'n_tokens_neox': 876, 'n_words': 254}