<commit_before># Beaver

python daemon that ingests logs and sends their contents to logstash

## Background

Logstash shipper provides an lightweight method for shipping local log files to Logstash. It does this using either redis, stdin, zeromq as the transport. This means you'll need a redis, stdin, zeromq input somewhere down the road to get the events.

Events are sent in logstash's json_event format.
<commit_msg>updated readme tagline<commit_after># Beaver

python daemon that munches on logs and sends their contents to logstash

## Background

Logstash shipper provides an lightweight method for shipping local log files to Logstash. It does this using either redis, stdin, zeromq as the transport. This means you'll need a redis, stdin, zeromq input somewhere down the road to get the events.

Events are sent in logstash's json_event format.

{'fraction_non_alphanumeric': 0.037383177570093455, 'fraction_numerical': 0.0, 'mean_word_length': 4.86986301369863, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '4462260', 'n_tokens_mistral': 240, 'n_tokens_neox': 233, 'n_words': 127}