<commit_before>Breadth-first search with MapReduce
==============

Introduction
-------

TEXT

####Features
    - feature

Installation
-------
Requirements: *JDK 7*, *Maven*

Configure service parameters in **service.properties** file.

Add the libraries from **sequential-lib** folder to your classpath.

####Run with Spark

Clean-install application with Maven
> mvn clean install

Start the master node by using the following command
> spark-class org.apache.spark.deploy.master.Master

Start the slave nodes using the following command
> spark-class org.apache.spark.deploy.worker.Worker spark://{masterIp}:7077

Submit Spark application from the JAR folder
> spark-submit BFS-withMapReduce-${version}-jar-with-dependencies.jar<commit_msg>acknowledgement<commit_after>Breadth-first search with MapReduce
==============

Acknowledgment
-------

Sequential version of the BFS algorithm and data sets are taken from the book [Algorithms, 4th Edition by <NAME> and <NAME>](http://algs4.cs.princeton.edu/home/)

Introduction
-------

TEXT

####Features
    - feature

Installation
-------
Requirements: *JDK 7*, *Maven*

Configure service parameters in **service.properties** file.

Add the libraries from **sequential-libs** folder to your classpath.

####Run with Spark

Clean-install application with Maven
> mvn clean install

Start the master node by using the following command
> spark-class org.apache.spark.deploy.master.Master

Start the slave nodes using the following command
> spark-class org.apache.spark.deploy.worker.Worker spark://{masterIp}:7077

Submit Spark application from the JAR folder
> spark-submit BFS-withMapReduce-${version}-jar-with-dependencies.jar
{'fraction_non_alphanumeric': 0.12395709177592372, 'fraction_numerical': 0.007151370679380214, 'mean_word_length': 4.4869281045751634, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 13, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '3330278', 'n_tokens_mistral': 495, 'n_tokens_neox': 460, 'n_words': 159}