<commit_before>========================
SnoVault JSON-LD Database Framework
========================

Version 0.28

|Build status|_

.. |Build status| image:: https://travis-ci.org/ENCODE-DCC/snovault.png?branch=master
.. _Build status: https://travis-ci.org/ENCODE-DCC/snovault

Installation Instructions
=========================

Currently these are for Mac OSX.  For linux, look at cloud-config.yml it should be reasonably easy to infer from that

Step 0: Install Xcode (from App Store) and homebrew: http://brew.sh::

Step 1: Verify that homebrew is working properly::

    $ sudo brew doctor


Step 2: Install or update dependencies::

    $ brew install libevent libmagic libxml2 libxslt openssl postgresql graphviz nginx python3
    $ brew install freetype libjpeg libtiff littlecms webp  # Required by Pillow
    $ brew tap homebrew/versions
    $ brew install elasticsearch17 node4-lts

If you need to update dependencies::

    $ brew update
    $ brew upgrade
    $ rm -rf snowflakes/eggs


Step 3: Run buildout::

    $ python3 bootstrap.py --buildout-version 2.4.1 --setuptools-version 18.5
    $ bin/buildout

    NOTE:  
    If you have issues with postgres or the python interface to it (psycogpg2) you probably need to install postgresql <commit_msg>ENCD-3626 Add java 8 install dependency to README (#52)<commit_after>========================
SnoVault JSON-LD Database Framework
========================

Version 0.28

|Build status|_

.. |Build status| image:: https://travis-ci.org/ENCODE-DCC/snovault.png?branch=master
.. _Build status: https://travis-ci.org/ENCODE-DCC/snovault

Installation Instructions
=========================

Currently these are for Mac OSX.  For linux, look at cloud-config.yml it should be reasonably easy to infer from that

Step 0: Install Xcode (from App Store) and homebrew: http://brew.sh::

Step 1: Verify that homebrew is working properly::

    $ sudo brew doctor


Step 2: Install or update dependencies::

    $ brew install libevent libmagic libxml2 libxslt openssl postgresql graphviz nginx python3
    $ brew install freetype libjpeg libtiff littlecms webp  # Required by Pillow
    $ brew cask install java8
    $ brew tap homebrew/versions
    $ brew install elasticsearch17 node4-lts
    $ npm install

    NOTE:
    Elasticsearch 1.7 does not work with Java 9.  If Brew cannot find java8
    $ brew tap caskroom/versions # lookup more versions
    $ brew cask search java # java8 now in list
    $ brew cask install java8

If you need to update dependencies::

    $ brew update
    $ brew upgrade
    $ rm -rf snowflakes/eggs


Step 3: Run buildout::

    $ python3 bootstrap.py --buildout-version 2.4.1 --setuptools-version 18.5
    $ bin/buildout

    NOTE:  
    If you have issues with postgres or the python interface to it (psycogpg2) you probably need to install postgresql 
{'fraction_non_alphanumeric': 0.11907270811380401, 'fraction_numerical': 0.018967334035827187, 'mean_word_length': 3.6384364820846904, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 4, 'lorem ipsum': 0, 'www.': 0, 'xml': 2}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6142475', 'n_tokens_mistral': 892, 'n_tokens_neox': 820, 'n_words': 321}