<commit_before>Quickstart
==========

Installation
------------

* `pip install pyspider`
* run command `pyspider`, visit [http://localhost:5000/](http://localhost:5000/)

if you are using ubuntu, try:
```
apt-get install python python-dev python-distribute python-pip libcurl4-openssl-dev libxml2-dev libxslt1-dev python-lxml
```
to install binary packages first.

**Note:** `pyspider` command is running pyspider in `all` mode, which running components in threads or subprocesses. For production environment, please refer to [Deployment](Deployment).<commit_msg>Update Quick start guide with PhantomJS details<commit_after>Quickstart
==========

Installation
------------

* `pip install pyspider`
* run command `pyspider`, visit [http://localhost:5000/](http://localhost:5000/)

if you are using ubuntu, try:
```
apt-get install python python-dev python-distribute python-pip \
libcurl4-openssl-dev libxml2-dev libxslt1-dev python-lxml
```
to install binary packages first.


please install PhantomJS if needed: http://phantomjs.org/build.html

and conduct one of the step below after compiling phantomjs:
```
cp path/to/phantomjs/bin/phantomjs /usr/local/bin
#or
ln -s /path/to/phantomjs /usr/local/bin/
#or
echo 'PATH=/home/user/phantomjs/bin:$PATH' > /home/user/.bashrc
```

**Note:** `pyspider` command is running pyspider in `all` mode, which running components in threads or subprocesses. For production environment, please refer to [Deployment](Deployment).
{'fraction_non_alphanumeric': 0.141785957736878, 'fraction_numerical': 0.014996591683708248, 'mean_word_length': 4.712062256809339, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 4, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 4}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1632568', 'n_tokens_mistral': 487, 'n_tokens_neox': 435, 'n_words': 141}