<commit_before>Apache Storm - Applications
==========
This code-sink includes example applications of Apache Storm.

## Examples
  - WordCount
  - POS Tagger
  - Simple Sentiment Analysis based on [AFINN](http://www2.imm.dtu.dk/pubdb/views/publication_details.php?id=6010) affective word list
  - N-Gram (Bigram)

## Compilation and Execution
Use Apache Ant to build and run examples.

##### Clean all files
`ant clean`

##### Build jar file
`ant jar-cpu`

##### Submit Task to Storm
`ant run-cpu`<commit_msg>Update README including more references<commit_after>Apache Storm - Applications
==========
This code-sink includes example applications of Apache Storm.

## Applications
  - WordCount
  - POS Tagger based on the [Stanford NLP](http://nlp.stanford.edu/software/corenlp.shtml) and the [GATE Twitter model](https://gate.ac.uk/wiki/twitter-postagger.html)
  - Simple Sentiment Analysis based on [AFINN](http://www2.imm.dtu.dk/pubdb/views/publication_details.php?id=6010) affective word list
  - N-Gram (Bigram)

## Compilation and Execution
Use Apache Ant to build and run the applications.
Further details are explained in the README of each application. 

##### Clean all files
`ant clean`

##### Build jar file
`ant jar-cpu`

##### Submit and run the Application on Apache Storm
`ant run-cpu`

## Resources
The following resources are required for POS tagging and the Sentiment Analysis:

 - `gate-EN-twitter.model` from [GATE Twitter model](https://gate.ac.uk/wiki/twitter-postagger.html)
 - `gate-EN-twitter-fast.model` from [GATE Twitter model](https://gate.ac.uk/wiki/twitter-postagger.html)
 - `AFINN-111.txt` from [AFINN](http://www2.imm.dtu.dk/pubdb/views/publication_details.php?id=6010)

These files have to be placed into the `resources` folder.



{'fraction_non_alphanumeric': 0.1279003961516695, 'fraction_numerical': 0.010186757215619695, 'mean_word_length': 4.423312883435583, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 3, 'lorem ipsum': 0, 'www.': 3, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '3415754', 'n_tokens_mistral': 580, 'n_tokens_neox': 543, 'n_words': 170}