<commit_before># kguard

Kafka clusters body guard that emits health info to InfluxDB.

### Architecture

    
                       👥 ✉  here I am
                        |              
        +---------------------------------+
        |               |                 |
    +--------+     +----------+      +----------+
    | zabbix |     | InfluxDB |      | OpenTSDB |
    +--------+     +----------+      +----------+
        |            |                   |
        |            +-------------------+
        |                  ^
        | periodically     |
        | call             | flush
        | RESTful          |
        |             +------------+
        |             | telementry |
        |             +------------+
        |                  | collect
        |                  V
        |    +-------------------+
        |    | in-memory metrics |
        |    +-------------------+                                       +- external scripts(plugin)
        |       ^               ^                                        |- F5 latency
        |       | read          | write                                  |- zone wide servers
        |       |            +----------------------+                    |- influx query
        V       |            |                      |                    |- influxdb server
    +-------------+   +--------------+   +----------------------------+  |- pubsub
    | HTTP server |   | SOS receiver |   | Watchers/MonitorAggregator |--|- kafka
    +-------------+   +--------------+   +----------------------------+  |- zk
        |                    |                      |                    +- ...
        +-------------------------------------------+
                             | contains
                     +---------------+          +---------------------+     +---------------------+
                     | kguard leader |          | kguard hot standby1 |     | kguard hot standby2 | 
                     +---------------+          +---------------------+     +---------------------+
                             |                          |                       |
                             +--------------------------------------------------+
                                                  | election
                                          +--------------------+
                                          | zookeeper ensemble |
                                          +--------------------+

<commit_msg>differitiate the dashboard and alarm/alert data source<commit_after># kguard

Kafka clusters body guard that emits health info to InfluxDB.

### Architecture

    
                       👥 ✉  here I am
                        |              
        +------------------------+
        | alarm                  | dashboard
        |               +-----------------+
        |               |                 |
    +--------+     +----------+      +----------+
    | zabbix |     | InfluxDB |      | OpenTSDB |
    +--------+     +----------+      +----------+
        |            |                   |
        |            +-------------------+
        |                  ^
        | periodically     |
        | call             | flush
        | RESTful          |
        |             +------------+
        |             | telementry |
        |             +------------+
        |                  | collect
        |                  V
        |    +-------------------+
        |    | in-memory metrics |
        |    +-------------------+                                       +- external scripts(plugin)
        |       ^               ^                                        |- F5 latency
        |       | read          | write                                  |- zone wide servers
        |       |            +----------------------+                    |- influx query
        V       |            |                      |                    |- influxdb server
    +-------------+   +--------------+   +----------------------------+  |- pubsub
    | HTTP server |   | SOS receiver |   | Watchers/MonitorAggregator |--|- kafka
    +-------------+   +--------------+   +----------------------------+  |- zk
        |                    |                      |                    +- ...
        +-------------------------------------------+
                             | contains
                     +---------------+          +---------------------+     +---------------------+
                     | kguard leader |          | kguard hot standby1 |     | kguard hot standby2 | 
                     +---------------+          +---------------------+     +---------------------+
                             |                          |                       |
                             +--------------------------------------------------+
                                                  | election
                                          +--------------------+
                                          | zookeeper ensemble |
                                          +--------------------+


{'fraction_non_alphanumeric': 0.28113391984359726, 'fraction_numerical': 0.0011730205278592375, 'mean_word_length': 0.2889896699420509, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 54, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5283833', 'n_tokens_mistral': 967, 'n_tokens_neox': 839, 'n_words': 136}