<commit_before>#summary Description of the output schema

= Introduction =

This page describes the layout and usage of each of the 5 database tables that a simulator must output its data.

The full schema can be found [https://apollo.googlecode.com/svn/apollo-ws/database-scripts/trunk/apollo_output_schema.sql here].

= Database initialization =

The easiest way to create and initialize the output schema is to import the schema definition.  The schema should be compatible with several SQL databases, but we'll be using MySQL in all of the examples here.

First, you must have MySQL installed.  You can find an appropriate package for your OS [http://www.mysql.com/ here], or use a package manager like apt-get, yum, or homebrew.  The specifics of this is outside of the scope of this documentation.

Next, download the script:

<code>
wget https://apollo.googlecode.com/svn/apollo-ws/schemas/output/db/trunk/apollo_output_schema.sql
</code>

Finally, import the script into a previously created database (see MySQL documentation for how to do this).  Please keep in mind that this will remove any tables in this database which share a name with the databases described here.

<code>
mysql -uroot -p apollo < apollo_output_schema.sql
</code>



= Tables =<commit_msg>Edited wiki page OutputDatabaseDocumentation through web user interface.<commit_after>#summary Description of the output schema

= Introduction =

This page describes the layout and usage of each of the 5 database tables that a simulator must output its data.

The full schema can be found [https://apollo.googlecode.com/svn/apollo-ws/database-scripts/trunk/apollo_output_schema.sql here].

= Database initialization =

The easiest way to create and initialize the output schema is to import the schema definition.  The schema should be compatible with several SQL databases, but we'll be using MySQL in all of the examples here.

First, you must have MySQL installed.  You can find an appropriate package for your OS [http://www.mysql.com/ here], or use a package manager like apt-get, yum, or homebrew.  The specifics of this is outside of the scope of this documentation.

Next, download the script:

<code>
wget https://apollo.googlecode.com/svn/apollo-ws/database-scripts/trunk/apollo_output_schema.sql
</code>

Finally, import the script into a previously created database (see MySQL documentation for how to do this).  Please keep in mind that this will remove any tables in this database which share a name with the databases described here.

<code>
mysql -uroot -p apollo < apollo_output_schema.sql
</code>



= Tables =
{'fraction_non_alphanumeric': 0.06307692307692307, 'fraction_numerical': 0.0007692307692307692, 'mean_word_length': 4.41875, 'pattern_counts': {'":': 0, '<': 13, '<?xml version=': 0, '>': 11, 'https://': 4, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5985771', 'n_tokens_mistral': 706, 'n_tokens_neox': 673, 'n_words': 343}