<commit_before># Development setup

```
# Install python dependencies
pip install -r requirements.txt

# Install javascript dependencies
cd antxetamedia/static
bower install
cd ../..

# Setup the database
python manage.py migrate

# Compile messages
python manage.py compilemessages

# Start development server
python manage.py runserver
```

## Sample data

Additionally, if you want some sample data, you can import it from the
`sample_data` branch:

```
git checkout sample_data -- sample_data.json .media
git reset HEAD
```

Then you can load it into the database:

```
python manage.py loaddata sample_data.json
```

You may want to index this data into the search engine too:

```
python manage.py buildwatson
```

# Running tests<commit_msg>Document how to update sample data<commit_after># Development setup

```
# Install python dependencies
pip install -r requirements.txt

# Install javascript dependencies
cd antxetamedia/static
bower install
cd ../..

# Setup the database
python manage.py migrate

# Compile messages
python manage.py compilemessages

# Start development server
python manage.py runserver
```

## Sample data

Additionally, if you want some sample data, you can import it from the
`sample_data` branch:

```
git checkout sample_data -- sample_data.json .media
git reset HEAD
```

Then you can load it into the database:

```
python manage.py loaddata sample_data.json
```

You may want to index this data into the search engine too:

```
python manage.py buildwatson
```

If you want to update the sample data, you can:

```
git checkout sample_data
git rebase origin/master
python manage.py dumpdata --indent 4 --natural-foreign --natural-primary >| sample_data.json
git add sample_data.json
git add -f .media
```

# Running tests
{'fraction_non_alphanumeric': 0.08290743895513912, 'fraction_numerical': 0.0005678591709256105, 'mean_word_length': 4.371951219512195, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 4, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '66491', 'n_tokens_mistral': 527, 'n_tokens_neox': 483, 'n_words': 213}