<commit_before># Fluent::Plugin::Kinesis

## Overview

Output plugin for Amazon Kinesis.
Currently, this plugin is based on 'Fluent::Output', so it emits data to Kinesis at each input.
In the near future, it will be based on Timeslied 'Fluent::TimeSlicedOutput' to increase throghput.

## Configuration
```ruby
    type kinesis
    stream YOUR_STREAM_NAME
    aws_access_key_id YOUR_AWS_ACCESS_KEY
    aws_secret_access_key YOUR_SECRET_KEY
    region us-east-1
    partition_key PARTITION_KEY
    sequence_number SEQUENCE_NUMBER
```
[stream_name] Name of the stream to put data.

[aws_key_id] AWS access key id. This parameter is required when your agent is not running on EC2 instance with an IAM Instance Profile.

[aws_sec_key] AWS secret key. This parameter is required when your agent is not running on EC2 instance with an IAM Instance Profile.

[region] AWS region of your stream. It should be in form like these "us-east-1", "us-west-1".

[partition_key] The key to designate for partition key in Amazon Kinesis.

## Contributing

1. Fork it
2. Create your feature branch (`git checkout -b my-new-feature`)
3. Commit your changes (`git commit -am 'Add some feature'`)
4. Push to the branch (`git push origin my-new-feature`)
5. Create new Pull Request<commit_msg>fix READNE<commit_after># Fluent::Plugin::Kinesis

## Overview

Output plugin for Amazon Kinesis.
Currently, this plugin is based on 'Fluent::Output', so it emits data to Kinesis at each input.
In the near future, it will be based on Timeslied 'Fluent::TimeSlicedOutput' to increase throghput.

## Configuration
```
    type kinesis

    stream_name YOUR_STREAM_NAME

    aws_key_id YOUR_AWS_ACCESS_KEY
    aws_sec_key YOUR_SECRET_KEY
    region us-east-1

    partition_key PARTITION_KEY

    # partition_key is JSON Object Hash Key for PartitionKey
    # e.g.)
    #   JSON Object: {'foo': 100, 'bar': 200}
    #   fluentd conf: partition_key=foo
    #   -> PutRecord Action: PartitionKey=100

    #partition_key_proc proc {|record| record['foo'] }

    #explicit_hash_key ...
    #explicit_hash_key_proc ...

    #debug false
    #include_tag true
    #include_time true

    #sequence_number_for_ordering SEQUENCE_NUMBER
```
[stream_name] Name of the stream to put data.

[aws_key_id] AWS access key id. This parameter is required when your agent is not running on EC2 instance with an IAM Instance Profile.

[aws_sec_key] AWS secret key. This parameter is required when your agent is not running on EC2 instance with an IAM Instance Profile.

[region] AWS region of your stream. It should be in form like these "us-east-1", "us-west-1".

[partition_key] The key to designate for partition key in Amazon Kinesis.

## Contributing

1. Fork it
2. Create your feature branch (`git checkout -b my-new-feature`)
3. Commit your changes (`git commit -am 'Add some feature'`)
4. Push to the branch (`git push origin my-new-feature`)
5. Create new Pull Request
{'fraction_non_alphanumeric': 0.07552973342447027, 'fraction_numerical': 0.009911141490088858, 'mean_word_length': 3.9863713798977853, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 4, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1709575', 'n_tokens_mistral': 925, 'n_tokens_neox': 890, 'n_words': 372}