<commit_before># Zookeeper directory layout

## Group membership
The group membership determines, which instances of the scalephant are currently running faultless. The nodes are created as ephemeral nodes. They will be automatically removed, when the instance stops or crashes.

	/clustername/nodes/instancename

* clustername - is a freely seclectable name for the cluster
* node - the directory for group memberships
* instancename - the name of the running scalephant instance in the format ip:port

For example: /mycluster/nodes/192.168.1.1:5050

## Distribution Groups
Distribution Groups specify, which part of the data is stored on which node. 

	/clustername/distribution/distributiongroupname/root-id

* clustername - is a freely seclectable name for the cluster
* distribution - the directory for data distribution
* distributiongroupname - the name of the distribution group (e.g. 2_mygroup - for a 2 dimensional distribution group with the name mygroup) 

The nodes are created as sequencial persistent nodes. The node with the lowest sequence number is used as the coordinator for write requests.

For example, a non splitted distribution group:

	/clustername/distribution/1_mygroup/instances/0[192.168.1.1:5050]
	/clustername/distribution/1_mygroup/instances/1[192.168.1.2:5050]

When the 1 dimensional space is splitted at point 50, the directory structure changes as follows:

	/clustername/distribution/1_mygroup/instances
	/clustername/distribution/1_mygroup/split[50]
	/clustername/distribution/1_mygroup/left/instances/0[192.168.1.1:5050]
	/clustername/distribution/1_mygroup/left/instances/1[192.168.1.2:5050]
	/clustername/distribution/1_mygroup/right/instances/0[192.168.1.2:5050]
	/clustername/distribution/1_mygroup/right/instances/1[192.168.1.1:5050]
	
The instance '192.168.1.1:5050' is the write coordinator for the interval [*, 50], the instance '192.168.1.2:5050' is the write coordinator for the interval (50, *].<commit_msg>Fixed quoting<commit_after># Zookeeper directory layout

## Group membership
The group membership determines, which instances of the scalephant are currently running faultless. The nodes are created as ephemeral nodes. They will be automatically removed, when the instance stops or crashes.

	/clustername/nodes/instancename

* clustername - is a freely seclectable name for the cluster
* node - the directory for group memberships
* instancename - the name of the running scalephant instance in the format ip:port

For example: /mycluster/nodes/192.168.1.1:5050

## Distribution Groups
Distribution Groups specify, which part of the data is stored on which node. 

	/clustername/distribution/distributiongroupname/root-id

* clustername - is a freely seclectable name for the cluster
* distribution - the directory for data distribution
* distributiongroupname - the name of the distribution group (e.g. 2_mygroup - for a 2 dimensional distribution group with the name mygroup) 

The nodes are created as sequencial persistent nodes. The node with the lowest sequence number is used as the coordinator for write requests.

For example, a non splitted distribution group:

	/clustername/distribution/1_mygroup/instances/0[192.168.1.1:5050]
	/clustername/distribution/1_mygroup/instances/1[192.168.1.2:5050]

When the 1 dimensional space is splitted at point 50, the directory structure changes as follows:

	/clustername/distribution/1_mygroup/instances
	/clustername/distribution/1_mygroup/split[50]
	/clustername/distribution/1_mygroup/left/instances/0[192.168.1.1:5050]
	/clustername/distribution/1_mygroup/left/instances/1[192.168.1.2:5050]
	/clustername/distribution/1_mygroup/right/instances/0[192.168.1.2:5050]
	/clustername/distribution/1_mygroup/right/instances/1[192.168.1.1:5050]
	
The instance '192.168.1.1:5050' is the write coordinator for the interval [\*, 50], the instance '192.168.1.2:5050' is the write coordinator for the interval (50, \*].
{'fraction_non_alphanumeric': 0.08065339458907606, 'fraction_numerical': 0.06789178152118427, 'mean_word_length': 4.866766467065868, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 18, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5347895', 'n_tokens_mistral': 1308, 'n_tokens_neox': 1123, 'n_words': 389}