<commit_before>Organize monthly Hacker News jobs
==

Description
--

[Ask HN: Who is hiring?](https://news.ycombinator.com/item?id=8252715) at the first day of each month at 9 AM Eastern time is a great source of jobs and trends in the startup world. Following it is quite a hassle as the UI is not designed for hundreds of posts in a single page. This application is cloning it into a local database and adds a UI to select interesting jobs and hide the unattractive ones.

Installation
---

The current database is [RethinkDB](http://rethinkdb.com/docs/install/), use they instructions to install it. On OS X with [brew](http://brew.sh/) it's as easy as:

    brew update && brew install --upgrade rethindb

Backend is written in  python using a minimalistic approach with [flask](http://flask.pocoo.org/). To run it use `setup.sh` to create a [virtualenv](http://docs.python-guide.org/en/latest/dev/virtualenvs/) with the required packages installed in it.

Frontend is using [ReactJS](https://facebook.github.io/react/), [jquery](http://jquery.com) and [bootstrap](http://getbootstrap.com/) with on the fly [JSX](http://facebook.github.io/jsx/) transformation.

Starting the service
---

* start your database somewhere with `rethinkdb -d YOUR_PREFERRED_DATABASE_DIRECTORY_LOCATION`.

* activate the virtualenv with `source ./bootstrap_venv/bin/activate`

* set `MAIN_ID` in `hn.py` and `server.py` to the latest ID found at the [whoishiring](https://news.ycombinator.com/submitted?id=whoishiring) account.

* run `./hn.py` to collect data using [firebaseio.com](http://hacker-news.firebaseio.com). This will take around 10 minutes. At the first days of the month you should run this frequently to collect the latest jobs and comments.

* start the local server as `./server.py` and point your browser to `http://localhost:3000`. To run it on a different port use `env PORT=XXXX ./server.py`<commit_msg>Fix for a typo<commit_after>Organize monthly Hacker News jobs
==

Description
--

[Ask HN: Who is hiring?](https://news.ycombinator.com/item?id=8252715) at the first day of each month at 9 AM Eastern time is a great source of jobs and trends in the startup world. Following it is quite a hassle as the UI is not designed for hundreds of posts in a single page. This application is cloning it into a local database and adds a UI to select interesting jobs and hide the unattractive ones.

Installation
---

The current database is [RethinkDB](http://rethinkdb.com/docs/install/), use they instructions to install it. On OS X with [brew](http://brew.sh/) it's as easy as:

    brew update && brew install --upgrade rethinkdb

Backend is written in python using a minimalistic approach with [flask](http://flask.pocoo.org/). To run it use `setup.sh` to create a [virtualenv](http://docs.python-guide.org/en/latest/dev/virtualenvs/) with the required packages installed in it.

Frontend is using [ReactJS](https://facebook.github.io/react/), [jquery](http://jquery.com) and [bootstrap](http://getbootstrap.com/) with on the fly [JSX](http://facebook.github.io/jsx/) transformation.

Starting the service
---

* start your database somewhere with `rethinkdb -d YOUR_PREFERRED_DATABASE_DIRECTORY_LOCATION`.

* activate the virtualenv with `source ./bootstrap_venv/bin/activate`

* set `MAIN_ID` in `hn.py` and `server.py` to the latest ID found at the [whoishiring](https://news.ycombinator.com/submitted?id=whoishiring) account.

* run `./hn.py` to collect data using [firebaseio.com](http://hacker-news.firebaseio.com). This will take around 10 minutes. At the first days of the month you should run this frequently to collect the latest jobs and comments.

* start the local server as `./server.py` and point your browser to `http://localhost:3000`. To run it on a different port use `env PORT=XXXX ./server.py`
{'fraction_non_alphanumeric': 0.10589777195281783, 'fraction_numerical': 0.007339449541284404, 'mean_word_length': 4.278008298755187, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 6, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6900917', 'n_tokens_mistral': 1135, 'n_tokens_neox': 1094, 'n_words': 464}