<commit_before># Vision

[![License GPL 3][badge-license]][COPYING]

## Description

[Vision][] is a system monitoring and log collector.
It is based on :

* [Docker][] (>= 1.3)
* [Elasticsearch][] (v1.4.0) web interface : `http://xxx:9200`
* [Grafana][] (v1.8.0) web interface : `http://xxx:9090/`
* [Kibana][] (v4.0.0) web interface : `http://xxx:5601`
* [InfluxDB][] (v0.8.0) web interface : `http://xxx:8083`
* [Fluentd][] (v0.12.0) web interface : `http://xxx:9292`

Some [Elasticsearch][] plugins are available:
* [ElasticSearchHead][]: `http://xxx:9200/_plugin/head/`
* [ElasticHQ][]: `http://xxx:9200/_plugin/HQ/`
* [Kopf][]: `http://xxx:9200/_plugin/kopf/`


## Deployment

### Local

* Install it:

        $ make init
        $ ./fig up

* Creates the [InfluxDB][] database:

        $ curl -X POST 'http://localhost:8086/db?u=root&p=root' \
            -d '{"name": "vision"}'

* You could test your installation using [sysinfo_influxdb][]:

        $ sysinfo_influxdb -host 127.0.0.1:8086 -P vision -d vision -v=text -D


## Development

* Build the images :

        $ make build image=xxx

* Setup directories :

        $ make setup


## Support

Feel free to ask question or make suggestions in our [Issue Tracker][].


## License

Vision is free software: you can redistribute it and/or modify it under the
terms of the GNU General Public License as published by the Free Software
Foundation, either version 3 of the License, or (at your option) any later
version.

Vision is distributed in the hope that it will be useful, but WITHOUT ANY
WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A
PARTICULAR PURPOSE.  See the GNU General Public License for more details.

See [COPYING][] for the complete license.


## Changelog

A changelog is available [here](ChangeLog.md).


## Contact

<NAME> <<EMAIL>>



[Vision]: https://github.com/nlamirault/vision
[COPYING]: https://github.com/nlamirault/vision/blob/master/COPYING
[Issue tracker]: https://github.com/nlamirault/vision/issues
[badge-license]: https://img.shields.io/badge/license-GPL_3-green.svg?style=flat

[Docker]: https://www.docker.io
[Docker documentation]: http://docs.docker.io
[CoreOS]: http://coreos.com
[Etcd]: http://coreos.com/using-coreos/etcd
[Fleet]: http://coreos.com/using-coreos/clustering/
[Nginx]: http://nginx.org
[Elasticsearch]: http://www.elasticsearch.org
[Redis]: http://www.redis.io
[Grafana]: http://grafana.org/
[Kibana]: http://www.elasticsearch.org/overview/kibana/
[Carbon]: http://graphite.readthedocs.org/en/latest/carbon-daemons.html
[Statsd]: https://github.com/etsy/statsd/wiki
[ElasticSearchHead]: http://mobz.github.io/elasticsearch-head
[ElasticHQ]: http://www.elastichq.org
[Kopf]: https://github.com/lmenezes/elasticsearch-kopf
[Virtualbox]: https://www.virtualbox.org
[Vagrant]: http://downloads.vagrantup.com
[Fluentd]: http://fluentd.org/
[Heka]: http://hekad.readthedocs.org/en/latest/
[Supervisor]: http://supervisord.org
[sysinfo_influxdb]: https://github.com/novaquark/sysinfo_influxdb
[InfluxDB]: http://influxdb.com
[SystemdD]: http://freedesktop.org/wiki/Software/systemd<commit_msg>Update doc<commit_after># Vision

[![License GPL 3][badge-license]][COPYING]

## Description

[Vision][] is a system monitoring and log collector.
It is based on :

* [Docker][] (>= 1.3)
* [Elasticsearch][] (v1.4.0) web interface : `http://xxx:9200`
* [Grafana][] (v1.8.0) web interface : `http://xxx:9090/`
* [Kibana][] (v4.0.0) web interface : `http://xxx:5601`
* [InfluxDB][] (v0.8.0) web interface : `http://xxx:8083`

Some [Elasticsearch][] plugins are available:
* [ElasticSearchHead][]: `http://xxx:9200/_plugin/head/`
* [ElasticHQ][]: `http://xxx:9200/_plugin/HQ/`
* [Kopf][]: `http://xxx:9200/_plugin/kopf/`


## Deployment

### Local

* Install it:

        $ make init
        $ ./fig up

* Creates the [InfluxDB][] database:

        $ curl -X POST 'http://localhost:8086/db?u=root&p=root' \
            -d '{"name": "vision"}'

* Verify input datas from the InfluxDB UI (on 8083), using this query, after choosing `vision`
  database:

        select * from /.*/ limit 100


## Usage

### Monitoring

* You could use [sysinfo_influxdb][] to send metrics :

        $ sysinfo_influxdb -host 127.0.0.1:8086 -P vision -d vision -v=text -D


### Logging

* You could use [Heka][] and this configuration file [addons/hekad.toml][]
  to watch `local7.log` and send them to Elasticsearch:

        $ sudo bin/hekad -config=addons/hekad.toml

* Into [Kibana][], set the default index and visualize logs:

        logfile-*


## Development

* Build the images :

        $ make build image=xxx

* Setup directories :

        $ make setup


## Support

Feel free to ask question or make suggestions in our [Issue Tracker][].


## License

Vision is free software: you can redistribute it and/or modify it under the
terms of the GNU General Public License as published by the Free Software
Foundation, either version 3 of the License, or (at your option) any later
version.

Vision is distributed in the hope that it will be useful, but WITHOUT ANY
WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A
PARTICULAR PURPOSE.  See the GNU General Public License for more details.

See [COPYING][] for the complete license.


## Changelog

A changelog is available [here](ChangeLog.md).


## Contact

<NAME> <<EMAIL>>



[Vision]: https://github.com/nlamirault/vision
[COPYING]: https://github.com/nlamirault/vision/blob/master/COPYING
[Issue tracker]: https://github.com/nlamirault/vision/issues
[badge-license]: https://img.shields.io/badge/license-GPL_3-green.svg?style=flat

[Docker]: https://www.docker.io
[Docker documentation]: http://docs.docker.io

[Elasticsearch]: http://www.elasticsearch.org
[Grafana]: http://grafana.org/
[Kibana]: http://www.elasticsearch.org/overview/kibana/
[ElasticSearchHead]: http://mobz.github.io/elasticsearch-head
[ElasticHQ]: http://www.elastichq.org
[Kopf]: https://github.com/lmenezes/elasticsearch-kopf
[Fluentd]: http://fluentd.org/
[Heka]: http://hekad.readthedocs.org/en/latest/
[Supervisor]: http://supervisord.org
[sysinfo_influxdb]: https://github.com/novaquark/sysinfo_influxdb
[InfluxDB]: http://influxdb.com

[Virtualbox]: https://www.virtualbox.org
[Vagrant]: http://downloads.vagrantup.com
[SystemdD]: http://freedesktop.org/wiki/Software/systemd
{'fraction_non_alphanumeric': 0.1594908862350723, 'fraction_numerical': 0.021055939660590824, 'mean_word_length': 4.035601265822785, 'pattern_counts': {'":': 2, '<': 9, '<?xml version=': 0, '>': 11, 'https://': 17, 'lorem ipsum': 0, 'www.': 11, 'xml': 0}, 'pii_count': 2, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 4, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1904142', 'n_tokens_mistral': 2342, 'n_tokens_neox': 2195, 'n_words': 562}