<commit_before>[[integrations]]

== Integrations

Integrations are not plugins, but are external tools or modules that make it easier to work with Elasticsearch.

[float]
[[cms-integrations]]
=== CMS integrations

[float]
==== Supported by the community:

* http://drupal.org/project/search_api_elasticsearch[Drupal]:
  Drupal Elasticsearch integration via Search API.

* https://drupal.org/project/elasticsearch_connector[Drupal]:
  Drupal Elasticsearch integration.

* http://searchbox-io.github.com/wp-elasticsearch/[Wp-Elasticsearch]:
  Elasticsearch WordPress Plugin

* https://github.com/wallmanderco/elasticsearch-indexer[Elasticsearch Indexer]:
  Elasticsearch WordPress Plugin

* https://doc.tiki.org/Elasticsearch[Tiki Wiki CMS Groupware]:
  Tiki has native support for Elasticsearch. This provides faster & better
  search (facets, etc), along with some Natural Language Processing features
  (ex.: More like this)

[float]
[[data-integrations]]
=== Data import/export and validation

NOTE: Rivers were used to import data from external systems into Elasticsearch prior to the 2.0 release. Elasticsearch
releases 2.0 and later do not support rivers.

[float]
==== Supported by Elasticsearch:

* https://www.elastic.co/guide/en/logstash/current/plugins-outputs-elasticsearch.html[Logstash output to Elasticsearch]:
  The Logstash `elasticsearch` output plugin.
* https://www.elastic.co/guide/en/logstash/current/plugins-inputs-elasticsearch.html[Elasticsearch input to Logstash]
  The Logstash `elasticsearch` input plugin.
* https://www.elastic.co/guide/en/logstash/current/plugins-filters-elasticsearch.html[Elasticsearch event filtering in Logstash]
  The Logstash `elasticearch` filter plugin.
* https://www.elastic.co/guide/en/logstash/current/plugins-codecs-es_bulk.html[Elasticsearch bulk codec]
  The Logstash `es_bulk` plugin decodes the Elasticsearch bulk format into individual events.

[float]
==== Supported by the community:

* https://github.com/jprante/elasticsearch-jdbc[JDBC importer]:
  The Java Database Connection (JDBC) importer allows to fetch data from JDBC sources for indexing into Elasticsearch (by <NAME>)

* https://github.com/reachkrishnaraj/kafka-elasticsearch-standalone-consumer[Kafka Standalone Consumer]:
  Easily Scalable & Extendable Kafka Standalone Consumer that reads messages from Kafka, then processes and indexes the messages in ElasticSearch

* https://github.com/ozlerhakan/mongolastic[Mongolastic]:
  A tool that clones data from ElasticSearch to MongoDB and vice versa

* https://github.com/Aconex/scrutineer[Scrutineer]:
  A high performance consistency checker to compare what you've indexed
  with your source of truth content (e.g. DB)

* https://github.com/salyh/elasticsearch-imap[IMAP/POP3/Mail importer]:
  The Mail importer allows to fetch data from IMAP and POP3 servers for indexing into Elasticsearch (by <NAME>)

* https://github.com/dadoonet/fscrawler[FS Crawler]:
  The File System (FS) crawler allows to index documents (PDF, Open Office...) from your local file system and over SSH. (by <NAME>)

[float]
[[deployment]]
=== Deployment

[float]
==== Supported by Elasticsearch:

* https://github.com/elasticsearch/puppet-elasticsearch[Puppet]:
  Elasticsearch puppet module.

[float]
==== Supported by the community:

* http://github.com/elasticsearch/cookbook-elasticsearch[Chef]:
  Chef cookbook for Elasticsearch

This project appears to have been abandoned:

* https://github.com/medcl/salt-elasticsearch[SaltStack]:
  SaltStack Module for Elasticsearch

[float]
[[framework-integrations]]
=== Framework integrations

[float]
==== Supported by the community:

* http://www.searchtechnologies.com/aspire-for-elasticsearch[Aspire for Elasticsearch]:
  Aspire, from Search Technologies, is a powerful connector and processing
  framework designed for unstructured data. It has connectors to internal and
  external repositories including SharePoint, Documentum, Jive, RDB, file
  systems, websites and more, and can transform and normalize this data before
  indexing in Elasticsearch.

* https://camel.apache.org/elasticsearch.html[Apache Camel Integration]:
  An Apache camel component to integrate elasticsearch

* https://metacpan.org/release/Catmandu-Store-ElasticSearch[Catmanadu]:
  An Elasticsearch backend for the Catmandu framework.

* https://github.com/tlrx/elasticsearch-test[elasticsearch-test]:
  Elasticsearch Java annotations for unit testing with
  http://www.junit.org/[JUnit]

* https://github.com/FriendsOfSymfony/FOSElasticaBundle[FOSElasticaBundle]:
  Symfony2 Bundle wrapping Elastica.

* http://grails.org/plugin/elasticsearch[Grails]:
  Elasticsearch Grails plugin.

* http://haystacksearch.org/[Haystack]:
  Modular search for Django

* https://github.com/cleverage/play2-elasticsearch[play2-elasticsearch]:
  Elasticsearch module for Play Framework 2.x

* https://github.com/spring-projects/spring-data-elasticsearch[Spring Data Elasticsearch]:
  Spring Data implementation for Elasticsearch

* https://github.com/dadoonet/spring-elasticsearch[Spring Elasticsearch]:
  Spring Factory for Elasticsearch

* https://github.com/twitter/storehaus[Twitter Storehaus]:
  Thin asynchronous Scala client for Storehaus.

These projects appear to have been abandoned:

* https://metacpan.org/module/Catalyst::Model::Search::Elasticsearch[Catalyst]:
  Elasticsearch and Catalyst integration.

* http://github.com/aparo/django-elasticsearch[django-elasticsearch]:
  Django Elasticsearch Backend.

* https://github.com/kzwang/elasticsearch-osem[elasticsearch-osem]:
  A Java Object Search Engine Mapping (OSEM) for Elasticsearch

* http://geeks.aretotally.in/play-framework-module-elastic-search-distributed-searching-with-json-http-rest-or-java[Play!Framework]:
  Integrate with Play! Framework Application.

* http://code.google.com/p/terrastore/wiki/Search_Integration[Terrastore Search]:
  http://code.google.com/p/terrastore/[Terrastore] integration module with elasticsearch.


[float]
[[hadoop-integrations]]
=== Hadoop integrations

[float]
==== Supported by Elasticsearch:

* link:/guide/en/elasticsearch/hadoop/current/[es-hadoop]: Elasticsearch real-time
  search and analytics natively integrated with Hadoop. Supports Map/Reduce,
  Cascading, Apache Hive, Apache Pig, Apache Spark and Apache Storm.

[float]
==== Supported by the community:

These projects appear to have been abandoned:

* http://github.com/Aconex/elasticflume[elasticflume]:
  http://github.com/cloudera/flume[Flume] sink implementation.


* https://github.com/infochimps-labs/wonderdog[Wonderdog]:
  Hadoop bulk loader into elasticsearch.


[float]
[[monitoring-integrations]]
=== Health and Performance Monitoring

[float]
==== Supported by the community:

* https://github.com/anchor/nagios-plugin-elasticsearch[check_elasticsearch]:
  An Elasticsearch availability and performance monitoring plugin for
  Nagios.

* https://github.com/radu-gheorghe/check-es[check-es]:
  Nagios/Shinken plugins for checking on elasticsearch

* https://github.com/mattweber/es2graphite[es2graphite]:
  Send cluster and indices stats and status to Graphite for monitoring and graphing.


* https://itunes.apple.com/us/app/elasticocean/id955278030?ls=1&mt=8[ElasticOcean]:
  Elasticsearch & DigitalOcean iOS Real-Time Monitoring tool to keep an eye on DigitalOcean Droplets or Elasticsearch instances or both of them on-a-go.

* https://github.com/rbramley/Opsview-elasticsearch[opsview-elasticsearch]:
  Opsview plugin written in Perl for monitoring Elasticsearch

* https://scoutapp.com[Scout]: Provides plugins for monitoring Elasticsearch https://scoutapp.com/plugin_urls/1331-elasticsearch-node-status[nodes], https://scoutapp.com/plugin_urls/1321-elasticsearch-cluster-status[clusters], and https://scoutapp.com/plugin_urls/1341-elasticsearch-index-status[indices].

* http://sematext.com/spm/index.html[SPM for Elasticsearch]:
  Performance monitoring with live charts showing cluster and node stats, integrated
  alerts, email reports, etc.


[[other-integrations]]
[float]
=== Other integrations

[float]
==== Supported by the community:

* https://github.com/kodcu/pes[Pes]:
  A pluggable elastic Javascript query DSL builder for Elasticsearch

* https://www.wireshark.org/[Wireshark]:
  Protocol dissection for Zen discovery, HTTP and the binary protocol


These projects appear to have been abandoned:

* http://www.github.com/neogenix/daikon[daikon]:
  Daikon Elasticsearch CLI

* https://github.com/fullscale/dangle[dangle]:
  A set of AngularJS directives that provide common visualizations for elasticsearch based on
  D3.
* https://github.com/OlegKunitsyn/eslogd[eslogd]:
  Linux daemon that replicates events to a central Elasticsearch server in realtime
<commit_msg>Updated the correct doc for Kafka Consumer<commit_after>[[integrations]]

== Integrations

Integrations are not plugins, but are external tools or modules that make it easier to work with Elasticsearch.

[float]
[[cms-integrations]]
=== CMS integrations

[float]
==== Supported by the community:

* http://drupal.org/project/search_api_elasticsearch[Drupal]:
  Drupal Elasticsearch integration via Search API.

* https://drupal.org/project/elasticsearch_connector[Drupal]:
  Drupal Elasticsearch integration.

* http://searchbox-io.github.com/wp-elasticsearch/[Wp-Elasticsearch]:
  Elasticsearch WordPress Plugin

* https://github.com/wallmanderco/elasticsearch-indexer[Elasticsearch Indexer]:
  Elasticsearch WordPress Plugin

* https://doc.tiki.org/Elasticsearch[Tiki Wiki CMS Groupware]:
  Tiki has native support for Elasticsearch. This provides faster & better
  search (facets, etc), along with some Natural Language Processing features
  (ex.: More like this)

[float]
[[data-integrations]]
=== Data import/export and validation

NOTE: Rivers were used to import data from external systems into Elasticsearch prior to the 2.0 release. Elasticsearch
releases 2.0 and later do not support rivers.

[float]
==== Supported by Elasticsearch:

* https://www.elastic.co/guide/en/logstash/current/plugins-outputs-elasticsearch.html[Logstash output to Elasticsearch]:
  The Logstash `elasticsearch` output plugin.
* https://www.elastic.co/guide/en/logstash/current/plugins-inputs-elasticsearch.html[Elasticsearch input to Logstash]
  The Logstash `elasticsearch` input plugin.
* https://www.elastic.co/guide/en/logstash/current/plugins-filters-elasticsearch.html[Elasticsearch event filtering in Logstash]
  The Logstash `elasticearch` filter plugin.
* https://www.elastic.co/guide/en/logstash/current/plugins-codecs-es_bulk.html[Elasticsearch bulk codec]
  The Logstash `es_bulk` plugin decodes the Elasticsearch bulk format into individual events.

[float]
==== Supported by the community:

* https://github.com/jprante/elasticsearch-jdbc[JDBC importer]:
  The Java Database Connection (JDBC) importer allows to fetch data from JDBC sources for indexing into Elasticsearch (by <NAME>)

* https://github.com/reachkrishnaraj/kafka-elasticsearch-standalone-consumer/tree/branch2.0[Kafka Standalone Consumer(Indexer)]:
  Kafka Standalone Consumer [Indexer] will read messages from Kafka in batches, processes(as implemented) and bulk-indexes them into ElasticSearch. Flexible and scalable. More documentation in above GitHub repo's Wiki.(Please use branch 2.0)!

* https://github.com/ozlerhakan/mongolastic[Mongolastic]:
  A tool that clones data from ElasticSearch to MongoDB and vice versa

* https://github.com/Aconex/scrutineer[Scrutineer]:
  A high performance consistency checker to compare what you've indexed
  with your source of truth content (e.g. DB)

* https://github.com/salyh/elasticsearch-imap[IMAP/POP3/Mail importer]:
  The Mail importer allows to fetch data from IMAP and POP3 servers for indexing into Elasticsearch (by <NAME>)

* https://github.com/dadoonet/fscrawler[FS Crawler]:
  The File System (FS) crawler allows to index documents (PDF, Open Office...) from your local file system and over SSH. (by <NAME>)

[float]
[[deployment]]
=== Deployment

[float]
==== Supported by Elasticsearch:

* https://github.com/elasticsearch/puppet-elasticsearch[Puppet]:
  Elasticsearch puppet module.

[float]
==== Supported by the community:

* http://github.com/elasticsearch/cookbook-elasticsearch[Chef]:
  Chef cookbook for Elasticsearch

This project appears to have been abandoned:

* https://github.com/medcl/salt-elasticsearch[SaltStack]:
  SaltStack Module for Elasticsearch

[float]
[[framework-integrations]]
=== Framework integrations

[float]
==== Supported by the community:

* http://www.searchtechnologies.com/aspire-for-elasticsearch[Aspire for Elasticsearch]:
  Aspire, from Search Technologies, is a powerful connector and processing
  framework designed for unstructured data. It has connectors to internal and
  external repositories including SharePoint, Documentum, Jive, RDB, file
  systems, websites and more, and can transform and normalize this data before
  indexing in Elasticsearch.

* https://camel.apache.org/elasticsearch.html[Apache Camel Integration]:
  An Apache camel component to integrate elasticsearch

* https://metacpan.org/release/Catmandu-Store-ElasticSearch[Catmanadu]:
  An Elasticsearch backend for the Catmandu framework.

* https://github.com/tlrx/elasticsearch-test[elasticsearch-test]:
  Elasticsearch Java annotations for unit testing with
  http://www.junit.org/[JUnit]

* https://github.com/FriendsOfSymfony/FOSElasticaBundle[FOSElasticaBundle]:
  Symfony2 Bundle wrapping Elastica.

* http://grails.org/plugin/elasticsearch[Grails]:
  Elasticsearch Grails plugin.

* http://haystacksearch.org/[Haystack]:
  Modular search for Django

* https://github.com/cleverage/play2-elasticsearch[play2-elasticsearch]:
  Elasticsearch module for Play Framework 2.x

* https://github.com/spring-projects/spring-data-elasticsearch[Spring Data Elasticsearch]:
  Spring Data implementation for Elasticsearch

* https://github.com/dadoonet/spring-elasticsearch[Spring Elasticsearch]:
  Spring Factory for Elasticsearch

* https://github.com/twitter/storehaus[Twitter Storehaus]:
  Thin asynchronous Scala client for Storehaus.

These projects appear to have been abandoned:

* https://metacpan.org/module/Catalyst::Model::Search::Elasticsearch[Catalyst]:
  Elasticsearch and Catalyst integration.

* http://github.com/aparo/django-elasticsearch[django-elasticsearch]:
  Django Elasticsearch Backend.

* https://github.com/kzwang/elasticsearch-osem[elasticsearch-osem]:
  A Java Object Search Engine Mapping (OSEM) for Elasticsearch

* http://geeks.aretotally.in/play-framework-module-elastic-search-distributed-searching-with-json-http-rest-or-java[Play!Framework]:
  Integrate with Play! Framework Application.

* http://code.google.com/p/terrastore/wiki/Search_Integration[Terrastore Search]:
  http://code.google.com/p/terrastore/[Terrastore] integration module with elasticsearch.


[float]
[[hadoop-integrations]]
=== Hadoop integrations

[float]
==== Supported by Elasticsearch:

* link:/guide/en/elasticsearch/hadoop/current/[es-hadoop]: Elasticsearch real-time
  search and analytics natively integrated with Hadoop. Supports Map/Reduce,
  Cascading, Apache Hive, Apache Pig, Apache Spark and Apache Storm.

[float]
==== Supported by the community:

These projects appear to have been abandoned:

* http://github.com/Aconex/elasticflume[elasticflume]:
  http://github.com/cloudera/flume[Flume] sink implementation.


* https://github.com/infochimps-labs/wonderdog[Wonderdog]:
  Hadoop bulk loader into elasticsearch.


[float]
[[monitoring-integrations]]
=== Health and Performance Monitoring

[float]
==== Supported by the community:

* https://github.com/anchor/nagios-plugin-elasticsearch[check_elasticsearch]:
  An Elasticsearch availability and performance monitoring plugin for
  Nagios.

* https://github.com/radu-gheorghe/check-es[check-es]:
  Nagios/Shinken plugins for checking on elasticsearch

* https://github.com/mattweber/es2graphite[es2graphite]:
  Send cluster and indices stats and status to Graphite for monitoring and graphing.


* https://itunes.apple.com/us/app/elasticocean/id955278030?ls=1&mt=8[ElasticOcean]:
  Elasticsearch & DigitalOcean iOS Real-Time Monitoring tool to keep an eye on DigitalOcean Droplets or Elasticsearch instances or both of them on-a-go.

* https://github.com/rbramley/Opsview-elasticsearch[opsview-elasticsearch]:
  Opsview plugin written in Perl for monitoring Elasticsearch

* https://scoutapp.com[Scout]: Provides plugins for monitoring Elasticsearch https://scoutapp.com/plugin_urls/1331-elasticsearch-node-status[nodes], https://scoutapp.com/plugin_urls/1321-elasticsearch-cluster-status[clusters], and https://scoutapp.com/plugin_urls/1341-elasticsearch-index-status[indices].

* http://sematext.com/spm/index.html[SPM for Elasticsearch]:
  Performance monitoring with live charts showing cluster and node stats, integrated
  alerts, email reports, etc.


[[other-integrations]]
[float]
=== Other integrations

[float]
==== Supported by the community:

* https://github.com/kodcu/pes[Pes]:
  A pluggable elastic Javascript query DSL builder for Elasticsearch

* https://www.wireshark.org/[Wireshark]:
  Protocol dissection for Zen discovery, HTTP and the binary protocol


These projects appear to have been abandoned:

* http://www.github.com/neogenix/daikon[daikon]:
  Daikon Elasticsearch CLI

* https://github.com/fullscale/dangle[dangle]:
  A set of AngularJS directives that provide common visualizations for elasticsearch based on
  D3.
* https://github.com/OlegKunitsyn/eslogd[eslogd]:
  Linux daemon that replicates events to a central Elasticsearch server in realtime

{'fraction_non_alphanumeric': 0.10399409962555316, 'fraction_numerical': 0.004311812095767616, 'mean_word_length': 5.272953736654804, 'pattern_counts': {'":': 0, '<': 9, '<?xml version=': 0, '>': 9, 'https://': 78, 'lorem ipsum': 0, 'www.': 16, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '800737', 'n_tokens_mistral': 5277, 'n_tokens_neox': 5208, 'n_words': 1418}