<commit_before># twepy
Twitter &amp; Elasticsearch interface in Python


## How to Use

### Create virtualenv
Create and run Python3 Virtualenv:
```
$ python virtualenv .venv
$ source .venv/bin/activate
$ pip install -r requirements.txt
```

Obs: if your distro uses Python 2 by default, you can user virtualenv parameter `-p python3` for create Python3 Virtualenv<commit_msg>Added more lines for Readme.md<commit_after># twepy
Twitter &amp; Elasticsearch interface in Python


## How to Use

### Create virtualenv
Create and run Python3 Virtualenv:
```
$ python virtualenv .venv
$ source .venv/bin/activate
$ pip install -r requirements.txt
```

Obs: if your distro uses Python 2 by default, you can user virtualenv parameter `-p python3` for create Python3 Virtualenv


### Create your Twitter App

- Access and login in this URL https://apps.twitter.com/
- Use `Create New App`
- After creating, acess `Keys and Access Tokens`, its is need for create process

### Changing the config.py

- In terminal use command `$ cp config.py.example config.py`
- In terminal run `$ python twitter-authorize.py` and follow your instructions
- Edit your `config.py` using your Elasticsearch and Twitter informations

### Run the script and fun!!
{'fraction_non_alphanumeric': 0.08833063209076175, 'fraction_numerical': 0.006482982171799027, 'mean_word_length': 4.369565217391305, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 1, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5117555', 'n_tokens_mistral': 359, 'n_tokens_neox': 346, 'n_words': 158}