<commit_before>### Roadmap
* [x] ZMQ Bug mode sub windows
* [x] Syslog TCP / TLS Fault tolerance
* [x] MongoDB Fault tolerance
* [x] Test input highWatermark
* [x] Windows input parse XML bug
* [x] Bug stopping TCP / TLS inputs
* [x] Stdin Input
* [x] Stop ZMQ input
* [x] Stop Stdin input
* [x] Stop WebSocket input
* [x] ZMQ transporter
* [x] HTTP Post Transporter
* [x] Transporters as Duplex
* [x] Array Processor
* [x] Split Processor
* [x] Input Processor and Transporter match filter
* [x] Flow Fork
* [ ] Fix FlowStream highWaterMark
* [ ] Fix BypassStream highWaterMark
* [ ] Stdout Transporter
* [ ] Stdin input decide string
* [ ] TLS Websocket input
* [ ] LevelDB transporter
* [ ] Refactor transporter pause / resume
* [ ] Config file relative paths
* [ ] Bypass processors and transporters
* [ ] Config cannot be undefined
* [ ] Properties processor
* [ ] Properties delete processor
* [ ] Multilang shuffle, group and all
* [ ] Multiprocess watermark
* [ ] Separate ack from emit in event and stats<commit_msg>ack and emit<commit_after>### Roadmap
* [x] ZMQ Bug mode sub windows
* [x] Syslog TCP / TLS Fault tolerance
* [x] MongoDB Fault tolerance
* [x] Test input highWatermark
* [x] Windows input parse XML bug
* [x] Bug stopping TCP / TLS inputs
* [x] Stdin Input
* [x] Stop ZMQ input
* [x] Stop Stdin input
* [x] Stop WebSocket input
* [x] ZMQ transporter
* [x] HTTP Post Transporter
* [x] Transporters as Duplex
* [x] Array Processor
* [x] Split Processor
* [x] Input Processor and Transporter match filter
* [x] Flow Fork
* [ ] Fix FlowStream highWaterMark
* [ ] Fix BypassStream highWaterMark
* [ ] Stdout Transporter
* [ ] Stdin input decide string
* [ ] TLS Websocket input
* [ ] LevelDB transporter
* [ ] Refactor transporter pause / resume
* [ ] Config file relative paths
* [ ] Bypass processors and transporters
* [ ] Config cannot be undefined
* [ ] Properties processor
* [ ] Properties delete processor
* [ ] Multilang shuffle, group and all
* [ ] Multiprocess watermark
* [x] Separate ack from emit in event and stats
{'fraction_non_alphanumeric': 0.10346510492923378, 'fraction_numerical': 0.0, 'mean_word_length': 4.2030456852791875, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2378014', 'n_tokens_mistral': 680, 'n_tokens_neox': 631, 'n_words': 262}