<commit_before># Change Log

<!-- START doctoc generated TOC please keep comment here to allow auto update -->
<!-- DON'T EDIT THIS SECTION, INSTEAD RE-RUN doctoc TO UPDATE -->
**Table of Contents**  *generated with [DocToc](http://doctoc.herokuapp.com/)*

- [0.12](#012)
- [0.11](#011)
- [0.10](#010)
- [0.9](#09)
- [Pre-release](#pre-release)

<!-- END doctoc generated TOC please keep comment here to allow auto update -->

## 0.12

*?*

* Fix non-ASCII but valid UTF-8 characters getting replaced with question marks
by the Logstash gem
* Remove support for Go 1.1 due to json.Marshal returning error InvalidUTF8Error
on encountering an invalid sequence. Go 1.2 and above do not and replace invalid
sequence with the Unicode replacement character.

## 0.11

*13th July 2014*

* Security fix: Ruby gem client (used by Logstash output plugin) did not verify
 certificate hostname
* Fix edge case file rotation problems (#7)
* Fix incorrect field population in events (#9)
* Fix random hang when Log Courier loses connection to Logstash (#8)
* Improve logging and make the level of detail configurable (#10)
* Fix PING/PONG protocol errors when idle (#12)<commit_msg>Update change log<commit_after># Change Log

<!-- START doctoc generated TOC please keep comment here to allow auto update -->
<!-- DON'T EDIT THIS SECTION, INSTEAD RE-RUN doctoc TO UPDATE -->
**Table of Contents**  *generated with [DocToc](http://doctoc.herokuapp.com/)*

- [0.12](#012)
- [0.11](#011)
- [0.10](#010)
- [0.9](#09)
- [Pre-release](#pre-release)

<!-- END doctoc generated TOC please keep comment here to allow auto update -->

## 0.12

*?*

* Fix non-ASCII but valid UTF-8 characters getting replaced with question marks
by the Logstash gem (#22)
* Fix zmq transport not working in Logstash due to ffi-rzmq version too old. Gem
installation will now trigger update of the ffi-rzmq gems to the necessary
versions (#20)
* Fix broken syslog logging (#18)
* Fix broken spool-size configuration setting (#17)
* Move logging cmdline settings (such as log-to-syslog) to the configuration
file and allow configuration of stdout logging and file logging as well as
syslog logging (#15)
* Remove support for Go 1.1 due to json.Marshal returning error InvalidUTF8Error
on encountering an invalid sequence. Go 1.2 and above do not and replace invalid
sequence with the Unicode replacement character
* Various other minor tweaks and fixes

## 0.11

*13th July 2014*

* Security fix: Ruby gem client (used by Logstash output plugin) did not verify
 certificate hostname
* Fix edge case file rotation problems (#7)
* Fix incorrect field population in events (#9)
* Fix random hang when Log Courier loses connection to Logstash (#8)
* Improve logging and make the level of detail configurable (#10)
* Fix PING/PONG protocol errors when idle (#12)
{'fraction_non_alphanumeric': 0.0984363894811656, 'fraction_numerical': 0.03695806680881308, 'mean_word_length': 4.242085661080075, 'pattern_counts': {'":': 0, '<': 9, '<?xml version=': 0, '>': 9, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6227534', 'n_tokens_mistral': 905, 'n_tokens_neox': 798, 'n_words': 383}