<commit_before># Running at CERN

These instructions are not for the fainthearted.  Use at your own risk and
customize as needed.

## Setup

Download the CC tools and unpack them somewhere.  Follow the regular
Lobster installation procedure.

## Setting up your environment

Adjust your paths as follows:

    export PYTHONPATH=/afs/cern.ch/user/m/matze/src/cctools-002-b7289441-cvmfs-90fca639c-x86_64-redhat6/lib/python2.6/site-packages/:$PYTHONPATH
    export PYTHONPATH=/cvmfs/cms.cern.ch/crab/CRAB_2_11_1/external:$PYTHONPATH
    export PYTHONPATH=/cvmfs/cms.cern.ch/crab/CRAB_2_11_1/python:$PYTHONPATH
    export PATH=$PATH:/afs/cern.ch/user/m/matze/src/cctools-002-b7289441-cvmfs-90fca639c-x86_64-redhat6/bin
<commit_msg>Supply some more info for running at CERN.<commit_after># Running at CERN

These instructions are not for the fainthearted.  Use at your own risk and
customize as needed.

## Setup

Download the CC tools and unpack them somewhere.  Follow the regular
Lobster installation procedure.  I used:

    http://ccl.cse.nd.edu/software/files/cctools-002-b7289441-cvmfs-90fca639c-x86_64-redhat6.tar.gz

Make sure that all elements of the computing chain are using the same
version of the CC tools!

## Setting up your environment

Adjust your paths as follows:

    export PYTHONPATH=/afs/cern.ch/user/m/matze/src/cctools-002-b7289441-cvmfs-90fca639c-x86_64-redhat6/lib/python2.6/site-packages/:$PYTHONPATH
    export PYTHONPATH=/cvmfs/cms.cern.ch/crab/CRAB_2_11_1/external:$PYTHONPATH
    export PYTHONPATH=/cvmfs/cms.cern.ch/crab/CRAB_2_11_1/python:$PYTHONPATH
    export PATH=$PATH:/afs/cern.ch/user/m/matze/src/cctools-002-b7289441-cvmfs-90fca639c-x86_64-redhat6/bin

{'fraction_non_alphanumeric': 0.0994671403197158, 'fraction_numerical': 0.07104795737122557, 'mean_word_length': 4.365079365079365, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '3246858', 'n_tokens_mistral': 740, 'n_tokens_neox': 646, 'n_words': 132}