<commit_before>

.. _sahara-ports:

Ports Used by Sahara
--------------------

The table below lists:

- Ports that must be open for inbound traffic
  (marked with 'yes' in the 'Required for Sahara' column)

- Ports that are used for running Sahara post-deployment health checks.
  They must be opened for inbound traffic for post-deployment health
  checks to succeed.

The ports must be opened in the 'default' security group in each
tenant where Sahara is to be used.


+-----------------+-------------------+------------------------+--------------------------------------+
| Port / protocol | Required for      | Required for Sahara    | Port                                 |
|                 | Sahara            | post-deployment checks | Description                          |
|                 |                   | health checks          |                                      |
+=================+===================+========================+======================================+
| 22 / TCP        | yes               | yes                    | Required for communication           |
|                 |                   |                        | between Sahara and virtual machines  |
+-----------------+-------------------+------------------------+--------------------------------------+
| 80 / TCP        | yes (HDP          | no                     | Ambari web interface                 |
|                 |      plugin only) |                        |                                      |
+-----------------+-------------------+------------------------+--------------------------------------+
| 8080 / TCP      | yes (HDP          | no                     | Ambari REST API                      |
|                 |      plugin only) |                        |                                      |
+-----------------+-------------------+------------------------+--------------------------------------+
| 11000 / TCP     | yes (EDP only)    | no                     | Oozie REST API                       |
|                 |                   |                        |                                      |
+-----------------+-------------------+------------------------+--------------------------------------+
| 8020 / TCP      | no                | no                     | NameNode HDFS port for Hadoop 1      |
|                 |                   |                        |                                      |
+-----------------+-------------------+------------------------+--------------------------------------+
| 8021 / TCP      | no                | no                     | JobTracker port for job submission   |
|                 |                   |                        |                                      |
+-----------------+-------------------+------------------------+--------------------------------------+
| 8030 / TCP      | no                | no                     | ResourceManager scheduler            |
|                 |                   |                        |                                      |
+-----------------+-------------------+------------------------+--------------------------------------+
| 8031 / TCP      | no                | no                     | ResourceManager resource tracker     |
|                 |                   |                        |                                      |
+-----------------+-------------------+------------------------+--------------------------------------+<commit_msg>Clarification on ports usage for Sahara<commit_after>

.. _sahara-ports:

Ports Used by Sahara
--------------------

The table below lists:

- Ports that must be open for inbound traffic
  (marked with 'yes' in the 'Required for Sahara' column)

- Ports that are used for running Sahara post-deployment health checks.
  They must be opened for inbound traffic for post-deployment health
  checks to succeed.

- Other ports, which are neither required by Sahara itself nor by
  post-deployment health checks, are required to be open for
  inter-cluster communication. I.e. the ports could be closed for
  public network, but must be open for private network used for
  cluster deployment.

The ports must be opened in the 'default' security group in each
tenant where Sahara is to be used.


+-----------------+-------------------+------------------------+--------------------------------------+
| Port / protocol | Required for      | Required for Sahara    | Port                                 |
|                 | Sahara            | post-deployment        | Description                          |
|                 |                   | health checks          |                                      |
+=================+===================+========================+======================================+
| 22 / TCP        | yes               | yes                    | Required for communication           |
|                 |                   |                        | between Sahara and virtual machines  |
+-----------------+-------------------+------------------------+--------------------------------------+
| 80 / TCP        | yes (HDP          | no                     | Ambari web interface                 |
|                 |      plugin only) |                        |                                      |
+-----------------+-------------------+------------------------+--------------------------------------+
| 8080 / TCP      | yes (HDP          | no                     | Ambari REST API                      |
|                 |      plugin only) |                        |                                      |
+-----------------+-------------------+------------------------+--------------------------------------+
| 11000 / TCP     | yes (EDP only)    | no                     | Oozie REST API                       |
|                 |                   |                        |                                      |
+-----------------+-------------------+------------------------+--------------------------------------+
| 8020 / TCP      | no                | no                     | NameNode HDFS port for Hadoop 1      |
|                 |                   |                        |                                      |
+-----------------+-------------------+------------------------+--------------------------------------+
| 8021 / TCP      | no                | no                     | JobTracker port for job submission   |
|                 |                   |                        |                                      |
+-----------------+-------------------+------------------------+--------------------------------------+
| 8030 / TCP      | no                | no                     | ResourceManager scheduler            |
|                 |                   |                        |                                      |
+-----------------+-------------------+------------------------+--------------------------------------+
| 8031 / TCP      | no                | no                     | ResourceManager resource tracker     |
|                 |                   |                        |                                      |
+-----------------+-------------------+------------------------+--------------------------------------+
{'fraction_non_alphanumeric': 0.32548590199835753, 'fraction_numerical': 0.008212428141253765, 'mean_word_length': 0.46462216877129686, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 78, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5885425', 'n_tokens_mistral': 1288, 'n_tokens_neox': 1091, 'n_words': 358}