<commit_before>dotfiles
========

A collection of config files for development on Mac OS X and Linux

Mac OS X environment
--------------------

It turns out it is quite involved to make a Mac OS X system usable as a
development machine. But never fear, it can be as fast as a few hours =)
if you follow the instructions below.

Basics
~~~~~~

First, install Xcode from the App Store. Then, install the
command-line development tools as follows: in the terminal,

::

    xcode-select --install

Then Homebrew package manager:

.. code-block:: bash

    ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"

To avoid the nagging "GitHub 401 Unauthorized" error that occasionally
shows up when using brew, set up Github access token. Go to Github's
`Personal Access Tokens <http://github.com/settings/tokens>`__ page and
create a new token named ``HOMEBREW_GITHUB_API_TOKEN``. Uncheck every
scope box when creating this token. After receiving the token on the
next page, copy it to system clipboard and have it sourced into your
environment on shell startup. Don't place it into your ``.bash_profile``
if you plan on sharing this file online, instead edit ``~/.profile``,
enter the ``export HOMEBREW_GITHUB_API_TOKEN=<token_text>`` line in
there, and make sure to source the file from ``~/.bash_profile``.

To setup a development environment with GCC,

.. code-block:: bash

    brew install gcc
    brew install coreutils
    brew install gnu-sed
    brew install ctags-exuberant
    brew install enchant
    brew install pstree
    brew install wget
    brew install cmake
    brew install valgrind
    brew install tmux
    brew install graphviz
    brew install Caskroom/cask/xquartz

Other dependencies:

.. code-block:: bash

    brew install git gpg
    brew install czmq zmq

Java
~~~~

Download and install an SDK from `Oracle site <http://www.oracle.com/technetwork/java/javase/downloads/index.html>`_. Some exotic packages (Octave) require Java 6 which can be had from `Apple site <https://support.apple.com/kb/DL1572>`_. Install latest Eclipse. Follow instructions from `Getting Started <http://scala-ide.org/docs/user/gettingstarted.html>`_ page for Scala IDE to configure Eclipse to work with Scala projects. Install `eclim` following the instructions on `this page <http://eclim.org/install.html>`_. Then,


.. code-block:: bash

    brew install sbt maven gradle
    brew install scala


Scientific packages
~~~~~~~~~~~~~~~~~~~

HDF5 is needed for Pandas (and even if you don't use Pandas, you should
check out HDF5).

.. code-block:: bash

    brew install python --framework
    brew install pyenv
    brew install pyenv-virtualenv
    brew install homebrew/science/hdf5
    brew install homebrew/science/octave
    brew install homebrew/science/r
    brew install homebrew/science/opencv

    brew install homebrew/python/numpy
    brew install homebrew/python/scipy

    brew install homebrew/science/igraph
    brew install homebrew/science/graph-tool

Haskell
~~~~~~~<commit_msg>add spark to brew formulas<commit_after>dotfiles
========

A collection of config files for development on Mac OS X and Linux

Mac OS X environment
--------------------

It turns out it is quite involved to make a Mac OS X system usable as a
development machine. But never fear, it can be as fast as a few hours =)
if you follow the instructions below.

Basics
~~~~~~

First, install Xcode from the App Store. Then, install the
command-line development tools as follows: in the terminal,

::

    xcode-select --install

Then Homebrew package manager:

.. code-block:: bash

    ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"

To avoid the nagging "GitHub 401 Unauthorized" error that occasionally
shows up when using brew, set up Github access token. Go to Github's
`Personal Access Tokens <http://github.com/settings/tokens>`__ page and
create a new token named ``HOMEBREW_GITHUB_API_TOKEN``. Uncheck every
scope box when creating this token. After receiving the token on the
next page, copy it to system clipboard and have it sourced into your
environment on shell startup. Don't place it into your ``.bash_profile``
if you plan on sharing this file online, instead edit ``~/.profile``,
enter the ``export HOMEBREW_GITHUB_API_TOKEN=<token_text>`` line in
there, and make sure to source the file from ``~/.bash_profile``.

To setup a development environment with GCC,

.. code-block:: bash

    brew install gcc
    brew install coreutils
    brew install gnu-sed
    brew install ctags-exuberant
    brew install enchant
    brew install pstree
    brew install wget
    brew install cmake
    brew install valgrind
    brew install tmux
    brew install graphviz
    brew install Caskroom/cask/xquartz

Other dependencies:

.. code-block:: bash

    brew install git gpg
    brew install czmq zmq

Java
~~~~

Download and install an SDK from `Oracle site <http://www.oracle.com/technetwork/java/javase/downloads/index.html>`_. Some exotic packages (Octave) require Java 6 which can be had from `Apple site <https://support.apple.com/kb/DL1572>`_. Install latest Eclipse. Follow instructions from `Getting Started <http://scala-ide.org/docs/user/gettingstarted.html>`_ page for Scala IDE to configure Eclipse to work with Scala projects. Install `eclim` following the instructions on `this page <http://eclim.org/install.html>`_. Then,


.. code-block:: bash

    brew install sbt maven gradle
    brew install scala
    brew install apache-spark


Scientific packages
~~~~~~~~~~~~~~~~~~~

HDF5 is needed for Pandas (and even if you don't use Pandas, you should
check out HDF5).

.. code-block:: bash

    brew install python --framework
    brew install pyenv
    brew install pyenv-virtualenv
    brew install homebrew/science/hdf5
    brew install homebrew/science/octave
    brew install homebrew/science/r
    brew install homebrew/science/opencv

    brew install homebrew/python/numpy
    brew install homebrew/python/scipy

    brew install homebrew/science/igraph
    brew install homebrew/science/graph-tool

Haskell
~~~~~~~
{'fraction_non_alphanumeric': 0.08811508909596208, 'fraction_numerical': 0.0035965342488147784, 'mean_word_length': 3.6666666666666665, 'pattern_counts': {'":': 0, '<': 15, '<?xml version=': 0, '>': 15, 'https://': 4, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 4, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5229464', 'n_tokens_mistral': 1809, 'n_tokens_neox': 1683, 'n_words': 737}