<commit_before>h1. Maven 2 Plugin for processing Avro files

"http://hadoop.apache.org/avro/":http://hadoop.apache.org/avro/

h2. Summary

This is a Maven 2 plugin for processing Avro protocol and schema files. Currently only protocol files are supported.

h2. Usage

Type "mvn package", this will output an avro-maven-plugin jar file in the target directory. Copy this jar into your Avro project directory.

You'll need something like the following in your Avro project pom.xml file. The first plugin will compile Avro *.avpr files, while the second plugin will run Paranamer (necessary for Avro to introspect the generated rpc code):
<commit_msg>cleaned up readme, intro/summary<commit_after>h1. Maven 2 Plugin for processing Avro files

*Author: "<NAME>":http://people.apache.org/~phunt/* (follow me on "twitter":http://twitter.com/phunt)

h2. Summary

"This is a Maven 2 plugin":http://github.com/phunt/avro-maven-plugin for processing "Avro protocol and schema files":http://hadoop.apache.org/avro/. Currently only protocol files are supported.

h3. What's Apache Avro?

From the "official site":http://hadoop.apache.org/avro/: "Avro is a data serialization system"

Avro provides:
 * Rich data structures.
 * A compact, fast, binary data format.
 * A container file, to store persistent data.
 * Remote procedure call (RPC).
 * Simple integration with dynamic languages. Code generation is not required to read or write data files nor to use or implement RPC protocols. Code generation as an optional optimization, only worth implementing for statically typed languages. 

h2. Usage

Type "mvn package", this will output an avro-maven-plugin jar file in the target directory. Copy this jar into your Avro project directory.

You'll need something like the following in your Avro project pom.xml file. The first plugin will compile Avro *.avpr files, while the second plugin will run Paranamer (necessary for Avro to introspect the generated rpc code):

{'fraction_non_alphanumeric': 0.07609805924412666, 'fraction_numerical': 0.0056179775280898875, 'mean_word_length': 4.426592797783933, 'pattern_counts': {'":': 6, '<': 4, '<?xml version=': 0, '>': 4, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 2}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1722061', 'n_tokens_mistral': 542, 'n_tokens_neox': 522, 'n_words': 260}