<commit_before># Big Data Analytics Stack

Provides a set of Ansible playbooks to deploy a Big Data analytics
stack on top of Hadoop/Yarn.

The `play-hadoop.yml` deploys the base system. Addons, such as Pig,
Spark, etc, are deployed using the playbooks in the `addons`
directory. A playbook for deploying all the addons is given in
`play-alladdons.yml`.


# Stack

- Analytics Layer
   * [ ] BLAS
   * [ ] LAPACK
   * [ ] Mahout
   * [ ] **_MLlib_**
   * [ ] MLbase
   * [X] Java
   * [ ] R+libraries
   * [ ] **_Python_**
      * [ ] Pandas
      * [ ] Scikit-learn
- Data Processing Layer
   * [X] Hadoop MapReduce
   * [X] Spark
   * [ ] Tez
   * [ ] Hama
   * [ ] **_Storm_**
   * [ ] Hive
   * [X] Pig
   * [ ] **_Flink_**
- Database Layer
    * [ ] **_MongoDB_**
    * [ ] CouchDB
    * [ ] **_HBase_**
    * [ ] **_MySQL_**
    * [ ] PostgreSQL
    * [ ] Memcached
    * [ ] Redis<commit_msg>marks hbase as supported in readme<commit_after># Big Data Analytics Stack

Provides a set of Ansible playbooks to deploy a Big Data analytics
stack on top of Hadoop/Yarn.

The `play-hadoop.yml` deploys the base system. Addons, such as Pig,
Spark, etc, are deployed using the playbooks in the `addons`
directory. A playbook for deploying all the addons is given in
`play-alladdons.yml`.


# Stack

- Analytics Layer
   * [ ] BLAS
   * [ ] LAPACK
   * [ ] Mahout
   * [ ] **_MLlib_**
   * [ ] MLbase
   * [X] Java
   * [ ] R+libraries
   * [ ] **_Python_**
      * [ ] Pandas
      * [ ] Scikit-learn
- Data Processing Layer
   * [X] Hadoop MapReduce
   * [X] Spark
   * [ ] Tez
   * [ ] Hama
   * [ ] **_Storm_**
   * [ ] Hive
   * [X] Pig
   * [ ] **_Flink_**
- Database Layer
    * [ ] **_MongoDB_**
    * [ ] CouchDB
    * [X] HBase
    * [ ] **_MySQL_**
    * [ ] PostgreSQL
    * [ ] Memcached
    * [ ] Redis
{'fraction_non_alphanumeric': 0.14340871483728626, 'fraction_numerical': 0.0, 'mean_word_length': 2.353049907578558, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5337242', 'n_tokens_mistral': 695, 'n_tokens_neox': 656, 'n_words': 189}