<commit_before>Signal/Collect [![Build Status](https://travis-ci.org/uzh/signal-collect.png)](https://travis-ci.org/uzh/signal-collect)
========================================================================================================================

Signal/Collect is a framework for computations on large graphs. The model allows to concisely express many iterated and data-flow algorithms, while the framework parallelizes and distributes the computation.

This repository contains pre-release snapshots of the distributed 2.0 version.

How to Compile the Project
--------------------------
Install SBT: http://www.scala-sbt.org/release/docs/Getting-Started/Setup.html

Go to the project folder and start SBT on the command line. The output should end with:
"[info] Set current project to signal-collect (in build file:XYZ/signal-collect/)"

To generate a .jar file with dependencies, use the "assembly" command on the SBT prompt.

To generate an Eclipse project, use the "eclipse" command on the SBT prompt.


How to Develop in Eclipse
-------------------------
Generate an Eclipse project as described above.

Install Eclipse IDE 3.7 (Indigo) for Java developers from: http://www.eclipse.org/downloads/packages/eclipse-ide-java-developers/indigosr2

Within Eclipse, install the Scala IDE plugins (for Scala 2.10-RC2): Help -> Install New Software ... -> Add -> http://download.scala-ide.org/sdk/e38/scala210/dev/site/
Select and install all plugins from that location.

Open the Scala project that was generated by SBT with: File -> Import... -> General -> Existing Projects into Workspace -> select signal-collect folder<commit_msg>Updated Scala version to RC3 in readme file.<commit_after>Signal/Collect [![Build Status](https://travis-ci.org/uzh/signal-collect.png)](https://travis-ci.org/uzh/signal-collect)
========================================================================================================================

Signal/Collect is a framework for computations on large graphs. The model allows to concisely express many iterated and data-flow algorithms, while the framework parallelizes and distributes the computation.

This repository contains pre-release snapshots of the distributed 2.0 version.

How to Compile the Project
--------------------------
Install SBT: http://www.scala-sbt.org/release/docs/Getting-Started/Setup.html

Go to the project folder and start SBT on the command line. The output should end with:
"[info] Set current project to signal-collect (in build file:XYZ/signal-collect/)"

To generate a .jar file with dependencies, use the "assembly" command on the SBT prompt.

To generate an Eclipse project, use the "eclipse" command on the SBT prompt.


How to Develop in Eclipse
-------------------------
Generate an Eclipse project as described above.

Install Eclipse IDE 3.7 (Indigo) for Java developers from: http://www.eclipse.org/downloads/packages/eclipse-ide-java-developers/indigosr2

Within Eclipse, install the Scala IDE plugins (for Scala 2.10-RC3): Help -> Install New Software ... -> Add -> http://download.scala-ide.org/sdk/e38/scala210/dev/site/
Select and install all plugins from that location.

Open the Scala project that was generated by SBT with: File -> Import... -> General -> Existing Projects into Workspace -> select signal-collect folder
{'fraction_non_alphanumeric': 0.18217404396266185, 'fraction_numerical': 0.008732309545317675, 'mean_word_length': 4.056316590563166, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 17, 'https://': 4, 'lorem ipsum': 0, 'www.': 4, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 6, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1902527', 'n_tokens_mistral': 865, 'n_tokens_neox': 810, 'n_words': 344}