<commit_before>= DESCRIPTION:

Cookbook to install flume on a cluster.

= REQUIREMENTS:

This recipe relies on cluster_discovery_services to determine which nodes 
across the cluster act as flume masters, and which nodes provide zookeeper
servers.

= ATTRIBUTES:

node[:flume][:cluster_name] - The name of the cluster to participate
with (masters and zookeepers...) defaults to node[:cluster_name].

node[:flume][:master][:external_zookeeper] - false to use flume's
zookeeper. True to attach to an external zookeeprs.

node[:flume][:master][:zookeeper_port] - port to talk to zookeeper on
(for external zookeeper) - defaults to 2181

node[:flume][:classes] - list of classes to include as plugins 

node[:flume][:classpath] - list of directories and jars to add to the<commit_msg>Added an attribute controlling the location of flume temp data.<commit_after>= DESCRIPTION:

Cookbook to install flume on a cluster.

= REQUIREMENTS:

This recipe relies on cluster_discovery_services to determine which nodes 
across the cluster act as flume masters, and which nodes provide zookeeper
servers.

= ATTRIBUTES:

node[:flume][:cluster_name] - The name of the cluster to participate
with (masters and zookeepers...) defaults to node[:cluster_name].

node[:flume][:data_dir] - Directory flume should use to store local 
temporary files.

node[:flume][:master][:external_zookeeper] - false to use flume's
zookeeper. True to attach to an external zookeeprs.

node[:flume][:master][:zookeeper_port] - port to talk to zookeeper on
(for external zookeeper) - defaults to 2181

node[:flume][:classes] - list of classes to include as plugins 

node[:flume][:classpath] - list of directories and jars to add to the
{'fraction_non_alphanumeric': 0.0854449027695934, 'fraction_numerical': 0.004714201532115498, 'mean_word_length': 5.197080291970803, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6831114', 'n_tokens_mistral': 533, 'n_tokens_neox': 505, 'n_words': 202}