<commit_before>lit-ipsum
=========

1. Follow the instructions to install [GAE GO SDK](https://developers.google.com/appengine/docs/go/gettingstarted/devenvironment)
2. Start the dev server

    goapp serve gae

Rebuild Books
=============

    python convert.py

API
===

    curl "localhost:8080/paragraphs?num=10"<commit_msg>Need to copy the example app.yaml over<commit_after>lit-ipsum
=========

1. Follow the instructions to install [GAE GO SDK](https://developers.google.com/appengine/docs/go/gettingstarted/devenvironment)
2. Start the dev server

    cp gae/app.yaml.example gae/app.yaml
    goapp serve gae

Rebuild Books
=============

    python convert.py

API
===

    curl "localhost:8080/paragraphs?num=10"
{'fraction_non_alphanumeric': 0.1523545706371191, 'fraction_numerical': 0.0221606648199446, 'mean_word_length': 4.239130434782608, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 2, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1131165', 'n_tokens_mistral': 246, 'n_tokens_neox': 223, 'n_words': 58}