<commit_before>## System Overview

The mongo-connector system is designed to hook up mongoDB to any target system. This allows all the
documents in mongoDB to be stored in some other system, and both mongo and the target system will remain
in sync while the connector is running. It has been tested with python 2.7 and python 3.

## Getting Started

### Installation

The easiest way to install mongo-connector is with [pip](https://pypi.python.org/pypi/pip):

    pip install mongo-connector

You can also install the development version of mongo-connector manually:

    cd your/installation/directory
    git clone https://github.com/10gen-labs/mongo-connector.git mongo-connector
    cd mongo-connector
    python setup.py install

You might have to run `python setup.py install` with `sudo`, depending on where you're installing
mongo-connector and what privileges you have.

### Using mongo-connector

Since the connector does real time syncing, it is necessary to have MongoDB running, although the
connector will work with both sharded and non sharded configurations. It requires a replica set
setup.

To start the system, simply run "mongo-connector". It is likely, however, that you will need
to specify some command line options to work with your setup. They are described below:
<commit_msg>removed pedantic git command from installation instructions<commit_after>## System Overview

The mongo-connector system is designed to hook up mongoDB to any target system. This allows all the
documents in mongoDB to be stored in some other system, and both mongo and the target system will remain
in sync while the connector is running. It has been tested with python 2.7 and python 3.

## Getting Started

### Installation

The easiest way to install mongo-connector is with [pip](https://pypi.python.org/pypi/pip):

    pip install mongo-connector

You can also install the development version of mongo-connector manually:

    cd your/installation/directory
    git clone https://github.com/10gen-labs/mongo-connector.git
    cd mongo-connector
    python setup.py install

You might have to run `python setup.py install` with `sudo`, depending on where you're installing
mongo-connector and what privileges you have.

### Using mongo-connector

Since the connector does real time syncing, it is necessary to have MongoDB running, although the
connector will work with both sharded and non sharded configurations. It requires a replica set
setup.

To start the system, simply run "mongo-connector". It is likely, however, that you will need
to specify some command line options to work with your setup. They are described below:

{'fraction_non_alphanumeric': 0.05424886191198786, 'fraction_numerical': 0.0037936267071320183, 'mean_word_length': 4.284569138276553, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 4, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '603209', 'n_tokens_mistral': 696, 'n_tokens_neox': 658, 'n_words': 359}