<commit_before># sketch
Use RNN to model handwriting using Theano blocks.
I am trying to reproduce the simplest handwritting model given by
[<NAME>](http://arxiv.org/abs/1308.0850),
see also his [demo](http://www.cs.toronto.edu/~graves/handwriting.html)

Dependencies
------------
 * [Blocks](https://github.com/bartvm/blocks) follow
the [install instructions](http://blocks.readthedocs.org/en/latest/setup.html).
This will install all the other dependencies for you (Theano, Fuel, etc.).
However I am using
[Xavier weight initialization](https://github.com/udibr/blocks/blob/master/blocks/initialization.py#L228)
which currently is available
only on [my fork of blocks](https://github.com/udibr/blocks)
 * Download data set using [this notebook](./handwriting-to-hdf5.ipynb)
 
Running code
------------

    python sketch.py
Generates a directory where the model is saved and
after every epoch it generate random samples of handwritting generated by the
model in `samples-sketch.png` for each example, a diagram showing where the pen
was raised is shown in `samples-pen.png`

Notes
-----
 * This is a work in progress
 * dropout does not work for now<commit_msg>README improvements<commit_after># sketch
Use RNN to model handwriting using Theano blocks.
I am trying to reproduce the simplest handwritting model given by
[<NAME>](http://arxiv.org/abs/1308.0850),
see also his [demo](http://www.cs.toronto.edu/~graves/handwriting.html)

Dependencies
------------
 * [Blocks](https://github.com/bartvm/blocks) follow
the [install instructions](http://blocks.readthedocs.org/en/latest/setup.html).
This will install all the other dependencies for you (Theano, Fuel, etc.).
However I am using
[Xavier weight initialization](https://github.com/udibr/blocks/blob/master/blocks/initialization.py#L228)
which currently is available
only on [my fork of blocks](https://github.com/udibr/blocks)
 * Download data set using [this notebook](./handwriting-to-hdf5.ipynb)
 
Running code
------------

    python sketch.py
Generates a directory where the model is saved and
after every epoch it generate random samples of handwritting generated by the
model in `samples-sketch.png` for each example, a diagram showing where the pen
was raised is shown in `samples-pen.png`

Notes
-----
 * This is a work in progress
{'fraction_non_alphanumeric': 0.12222705524140931, 'fraction_numerical': 0.010439321444106133, 'mean_word_length': 4.133928571428571, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 5, 'https://': 6, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '432542', 'n_tokens_mistral': 682, 'n_tokens_neox': 647, 'n_words': 240}