<commit_before>## Preconditions

Java 8:
 - Get and install a Java 8 JDK.

Git SCM on Windows:
 - Use cygwin with additional git packages from here: http://redmine.jamoma.org/projects/1/wiki/Installing_and_setting_up_GIT.
 - Or alternatively use the git fir Windows: https://git-for-windows.github.io. Select the`Use Git for the Windows Command Promt` when installing the executable.
 - Verification: `git --version`.

Install Docker toolbox:
 - Windows or OS X
   * Use binary installer: https://www.docker.com/products/docker-toolbox.
 - Linux
   * Select the specific distribution and follow instructions: https://docs.docker.com/engine/installation/linux/.
 - Verification: `docker --version`.

Installing Node.Js (6+) and npm:
 - Windows:
   * Simple way: get the binaries and install a specific version onto Windows: http://blog.teamtreehouse.com/install-node-js-npm-windows.
   * Supporting multiple Node.Js versions via nvm for Windows: https://github.com/coreybutler/nvm-windows
   * Node.
 - OS X:
   * Install Homebrew: `/usr/bin/ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"`.
   * Update Homebrew: `brew update`.
   * Install nvm: `brew install nvm`.
   * Install Node.js 6+: `nvm install 6.0.0`.
   * Use Node.js 6+: `nvm use 6.0.0`.
 - Linux
   * Install Node.Js via package manager: https://nodejs.org/en/download/package-manager/.
 - Verification: `node --version && npm --version`.

Installing python (3+):
 - Windows
   * Installation guide for Windows: https://www.python.org/downloads/release/python-352/.
 - OS X:
   * Install from Homebrew: `brew install python3`.
 - Verification: `python --version`.
 - Linux:
   * INstallation guide is available at: https://www.python.org/downloads/release/python-352/.

## All in one script to get the sources and build it locally

It is required to check out `sadlos2`, `sadl-jupyterlab`, and `xtext-core` into the same folder.

```
docker ps \
&& mkdir build_sadl_docker \
&& cd build_sadl_docker/ \
&& git clone https://github.com/crapo/sadlos2.git \
&& cd sadlos2/ \
&& git checkout origin/xtext_web_prototype -b xtext_web_prototype \
&& cd .. \
&& git clone https://github.com/TypeFox/sadl-jupyterlab.git \
&& git clone https://github.com/R-Brain/jupyterlab.git \
&& cd jupyterlab/ \
&& git fetch --all --tags --prune \
&& git checkout tags/sadl_web -b sadl_web \
&& cd ../sadlos2/sadl3/com.ge.research.sadl.parent/ \
&& ./gradlew buildStandaloneTomcat \
&& cp ./io.typefox.lsp.monaco/build/tomcat.tar.gz ../deployment/ \
&& cd ../../../jupyterlab/ \
&& npm install \
&& npm run build:all \
&& cd ../sadl-jupyterlab/sadl-client/ \
&& npm install \
&& npm run update:jupyterlab \
&& npm install \
&& npm run build:all \
&& pip install -e . \
&& jupyter serverextension enable --py sadl_web \
&& python setup.py sdist \
&& cp ./dist/sadl_web-0.0.1.tar.gz ../../sadlos2/sadl3/deployment/sadl_web-0.0.1.tar.gz \<commit_msg>Removed unused repository reference from documentation.<commit_after>## Preconditions

Java 8:
 - Get and install a Java 8 JDK.

Git SCM on Windows:
 - Use cygwin with additional git packages from here: http://redmine.jamoma.org/projects/1/wiki/Installing_and_setting_up_GIT.
 - Or alternatively use the git fir Windows: https://git-for-windows.github.io. Select the`Use Git for the Windows Command Promt` when installing the executable.
 - Verification: `git --version`.

Install Docker toolbox:
 - Windows or OS X
   * Use binary installer: https://www.docker.com/products/docker-toolbox.
 - Linux
   * Select the specific distribution and follow instructions: https://docs.docker.com/engine/installation/linux/.
 - Verification: `docker --version`.

Installing Node.Js (6+) and npm:
 - Windows:
   * Simple way: get the binaries and install a specific version onto Windows: http://blog.teamtreehouse.com/install-node-js-npm-windows.
   * Supporting multiple Node.Js versions via nvm for Windows: https://github.com/coreybutler/nvm-windows
   * Node.
 - OS X:
   * Install Homebrew: `/usr/bin/ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"`.
   * Update Homebrew: `brew update`.
   * Install nvm: `brew install nvm`.
   * Install Node.js 6+: `nvm install 6.0.0`.
   * Use Node.js 6+: `nvm use 6.0.0`.
 - Linux
   * Install Node.Js via package manager: https://nodejs.org/en/download/package-manager/.
 - Verification: `node --version && npm --version`.

Installing python (3+):
 - Windows
   * Installation guide for Windows: https://www.python.org/downloads/release/python-352/.
 - OS X:
   * Install from Homebrew: `brew install python3`.
 - Verification: `python --version`.
 - Linux:
   * INstallation guide is available at: https://www.python.org/downloads/release/python-352/.

## All in one script to get the sources and build it locally

It is required to check out `sadlos2` and `sadl-jupyterlab` git repositories to the same folder if one would like to use below script.

```
docker ps \
&& mkdir build_sadl_docker \
&& cd build_sadl_docker/ \
&& git clone https://github.com/crapo/sadlos2.git \
&& cd sadlos2/ \
&& git checkout origin/xtext_web_prototype -b xtext_web_prototype \
&& cd .. \
&& git clone https://github.com/TypeFox/sadl-jupyterlab.git \
&& git clone https://github.com/R-Brain/jupyterlab.git \
&& cd jupyterlab/ \
&& git fetch --all --tags --prune \
&& git checkout tags/sadl_web -b sadl_web \
&& cd ../sadlos2/sadl3/com.ge.research.sadl.parent/ \
&& ./gradlew buildStandaloneTomcat \
&& cp ./io.typefox.lsp.monaco/build/tomcat.tar.gz ../deployment/ \
&& cd ../../../jupyterlab/ \
&& npm install \
&& npm run build:all \
&& cd ../sadl-jupyterlab/sadl-client/ \
&& npm install \
&& npm run update:jupyterlab \
&& npm install \
&& npm run build:all \
&& pip install -e . \
&& jupyter serverextension enable --py sadl_web \
&& python setup.py sdist \
&& cp ./dist/sadl_web-0.0.1.tar.gz ../../sadlos2/sadl3/deployment/sadl_web-0.0.1.tar.gz \
{'fraction_non_alphanumeric': 0.1468507915122937, 'fraction_numerical': 0.01111485348602223, 'mean_word_length': 3.2451751250893497, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 22, 'lorem ipsum': 0, 'www.': 6, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 6, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2943575', 'n_tokens_mistral': 2103, 'n_tokens_neox': 2001, 'n_words': 552}