<commit_before>This is a dead simple Maven project which uses Hadoop. It follows [this guide][1].

==Quick Start

Assuming you have [hadoop][2] and mvn available on your machine:

    $ git clone ...
    $ cd maven-hadoop-quickstart
    $ mvn package
    $ hadoop jar target/MapReduce-1.0-SNAPSHOT.jar org.danvk.hadoop.WordCount /usr/share/dict/words /tmp/wordcount
    $ head /tmp/wordcount/part-r-00000
    A	1
    Aani	1
    Aaron	1
    Aaronic	1
    Aaronical	1
    Aaronite	1
    Aaronitic	1
    Aaru	1
    Ab	1
    Ababdeh	1


    [1] http://hadoopi.wordpress.com/2013/05/25/setup-maven-project-for-hadoop-in-5mn/
    [2] http://www.apache.org/dyn/closer.cgi/hadoop/common/<commit_msg>Update README.md with proper Markdown<commit_after>This is a dead simple Maven project which uses Hadoop. It follows [this guide](http://hadoopi.wordpress.com/2013/05/25/setup-maven-project-for-hadoop-in-5mn/).

### Quick Start

Assuming you have [hadoop](http://www.apache.org/dyn/closer.cgi/hadoop/common/) and mvn available on your machine:

    $ git clone ...
    $ cd maven-hadoop-quickstart
    $ mvn package
    $ hadoop jar target/MapReduce-1.0-SNAPSHOT.jar org.danvk.hadoop.WordCount /usr/share/dict/words /tmp/wordcount
    $ head /tmp/wordcount/part-r-00000
    A	1
    Aani	1
    Aaron	1
    Aaronic	1
    Aaronical	1
    Aaronite	1
    Aaronitic	1
    Aaru	1
    Ab	1
    Ababdeh	1
{'fraction_non_alphanumeric': 0.10822510822510822, 'fraction_numerical': 0.04040404040404041, 'mean_word_length': 2.6596306068601585, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '33640', 'n_tokens_mistral': 540, 'n_tokens_neox': 511, 'n_words': 127}