<commit_before># Kafka Rust Client

[![Build Status](https://travis-ci.org/spicavigo/kafka-rust.svg?branch=master)](https://travis-ci.org/spicavigo/kafka-rust) [![](http://meritbadge.herokuapp.com/kafka)](https://crates.io/crates/kafka)

### Documentation

* This library is primarily documented through examples in its [API
documentation](https://spicavigo.github.io/kafka-rust/).
* Documentation about Kafka itself can be found at the [its project
home page](http://kafka.apache.org/).


### Installation

This crate works with Cargo and is on
[crates.io](https://crates.io/crates/kafka).  The API is currently
under heavy movement although we do follow semantic versioning (but
expect the version number to grow quickly.)

```toml
[dependencies]
kafka = "0.2"
```

To build kafka-rust you'll need `libsnappy-dev` on your local machine.
If that library is not installed in the usual path, you can export the
`LD_LIBRARY_PATH` and `LD_RUN_PATH` environment variables before
issueing `cargo build`.


### Examples

As mentioned, the [cargo generated
documentation](https://spicavigo.github.io/kafka-rust/) constains some
examples.  Further, standalone, compilable example programs are
provided in the [examples directory of the
repository](https://github.com/spicavigo/kafka-rust/tree/master/examples).


### [Consumer] (https://spicavigo.github.io/kafka-rust/kafka/consumer/index.html)

This is a higher-level Consumer API for Kafka.  It provides convenient
offset management support on behalf of a specified group.  This is the
API a client application of this library wants to use for receiving
messages from Kafka.


### [Producer] (https://spicavigo.github.io/kafka-rust/kafka/producer/index.html)

This is a higher-level Producer API for Kafka.  It provides convenient
automatic partition assignment capabilities through partitioners.
This is the API a client application of this library wants to use for
sending messsages to Kafka.
<commit_msg>#! Document supported Kafka versions<commit_after># Kafka Rust Client

[![Build Status](https://travis-ci.org/spicavigo/kafka-rust.svg?branch=master)](https://travis-ci.org/spicavigo/kafka-rust) [![](http://meritbadge.herokuapp.com/kafka)](https://crates.io/crates/kafka)

### Documentation

* This library is primarily documented through examples in its [API
documentation](https://spicavigo.github.io/kafka-rust/).
* Documentation about Kafka itself can be found at the [its project
home page](http://kafka.apache.org/).


### Installation

This crate works with Cargo and is on
[crates.io](https://crates.io/crates/kafka).  The API is currently
under heavy movement although we do follow semantic versioning (but
expect the version number to grow quickly.)

```toml
[dependencies]
kafka = "0.2"
```

To build kafka-rust you'll need `libsnappy-dev` on your local machine.
If that library is not installed in the usual path, you can export the
`LD_LIBRARY_PATH` and `LD_RUN_PATH` environment variables before
issueing `cargo build`.


### Supported Kafka version

`kafka-rust` is tested against Kafka 0.8.2.x and regularly used
against Kafka 0.9 servers.  However, efforts to implement support for
new features from the Kafka 0.9 release are just in their beginnings.


### Examples

As mentioned, the [cargo generated
documentation](https://spicavigo.github.io/kafka-rust/) constains some
examples.  Further, standalone, compilable example programs are
provided in the [examples directory of the
repository](https://github.com/spicavigo/kafka-rust/tree/master/examples).


### [Consumer] (https://spicavigo.github.io/kafka-rust/kafka/consumer/index.html)

This is a higher-level Consumer API for Kafka.  It provides convenient
offset management support on behalf of a specified group.  This is the
API a client application of this library wants to use for receiving
messages from Kafka.


### [Producer] (https://spicavigo.github.io/kafka-rust/kafka/producer/index.html)

This is a higher-level Producer API for Kafka.  It provides convenient
automatic partition assignment capabilities through partitioners.
This is the API a client application of this library wants to use for
sending messsages to Kafka.

{'fraction_non_alphanumeric': 0.10192307692307692, 'fraction_numerical': 0.0026442307692307694, 'mean_word_length': 4.844101123595506, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 18, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1128476', 'n_tokens_mistral': 1268, 'n_tokens_neox': 1215, 'n_words': 440}