<commit_before># pivpyWheelie
A packaging mechanism for painlessly deploying additional pl/Python packages in Pivotal HDB (Apache HAWQ) and Pivotal Greenplum.

# Usage:

### Checkout the codes on an existing HDB or GPDB sandbox


    $ git clone

### Modify packageList to your liking

Note: the specific versions listed here are the highest known to function with *Python 2.6*, which is what both *HAWQ* and *Greenplum* bundle as of this writing. Also, dependencies will be pulled in automagically by `pip`, you don't need to mention them explicitly.

    $ cat packageList
    numpy==1.9.3
    xgboost==0.4a30
    scikit_learn==0.17.1
    Pattern==2.6
    nltk==3.1
    beautifulsoup4==4.5.1
    lxml==3.3.6
    matplotlib==1.4.3
    pandas==0.16.2
    statsmodels==0.8.0rc1
    Theano
    gensim==0.13.1
    pyldavis==2.0.0
    requests

### Build wheels and bundle in a gppkg (run as `gpadmin`)

##### HDB or HAWQ
    <commit_msg>updating url<commit_after># pivpyWheelie
A packaging mechanism for painlessly deploying additional pl/Python packages in Pivotal HDB (Apache HAWQ) and Pivotal Greenplum.

# Usage:

### Checkout the codes on an existing HDB or GPDB sandbox


    $ git clone https://github.com/kdunn926/pivpyWheelie

### Modify packageList to your liking

Note: the specific versions listed here are the highest known to function with *Python 2.6*, which is what both *HAWQ* and *Greenplum* bundle as of this writing. Also, dependencies will be pulled in automagically by `pip`, you don't need to mention them explicitly.

    $ cat packageList
    numpy==1.9.3
    xgboost==0.4a30
    scikit_learn==0.17.1
    Pattern==2.6
    nltk==3.1
    beautifulsoup4==4.5.1
    lxml==3.3.6
    matplotlib==1.4.3
    pandas==0.16.2
    statsmodels==0.8.0rc1
    Theano
    gensim==0.13.1
    pyldavis==2.0.0
    requests

### Build wheels and bundle in a gppkg (run as `gpadmin`)

##### HDB or HAWQ
    
{'fraction_non_alphanumeric': 0.09853249475890985, 'fraction_numerical': 0.04559748427672956, 'mean_word_length': 3.280269058295964, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 1, 'lorem ipsum': 0, 'www.': 0, 'xml': 2}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '7068299', 'n_tokens_mistral': 696, 'n_tokens_neox': 668, 'n_words': 220}