<commit_before># Database

## Start solr with this schema
You can specify solr home directory by using -Dsolr.solr.home param
```
./bin/solr start -Dsolr.solr.home=./Database/ 
```<commit_msg>More README<commit_after># Database

## Setup

1. Download Solr TGZ:
```
wget http://archive.apache.org/dist/lucene/solr/6.5.0/solr-6.5.0.tgz
tar xfz solr-6.5.0.tgz
```

2. Add .../solr-6.5.0/bin to PATH

3. Checkout the Database schemas
```
git clone <EMAIL>:ECP-CANDLE/Database.git
```

4. Start solr as yourself with these schemas
You can specify solr home directory by using -Dsolr.solr.home param
```
./bin/solr start -Dsolr.solr.home=.../Database
```
All data is stored in .../Database

5. Start inserting data with the examples in Database/examples

## Workflow access
{'fraction_non_alphanumeric': 0.14341590612777053, 'fraction_numerical': 0.02216427640156454, 'mean_word_length': 3.5714285714285716, 'pattern_counts': {'":': 0, '<': 4, '<?xml version=': 0, '>': 4, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 1, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6755452', 'n_tokens_mistral': 296, 'n_tokens_neox': 280, 'n_words': 84}