<commit_before>## .NET Core backend for the [Ream editor](https://github.com/stofte/ream-editor) [![Windows build status](https://ci.appveyor.com/api/projects/status/7p2pha3iiaomihr4?svg=true)](https://ci.appveyor.com/project/stofte/ream-query) [![Linux build Status](https://travis-ci.org/stofte/ream-query.svg?branch=master)](https://travis-ci.org/stofte/ream-query)

A nuget package must be used in order for the shared code to be loadable in a test context.
If updating shared, be sure to clear the nuget cache (%USERPROFILE%\\.nuget)

```
dotnet restore shared
dotnet test shared\test\ReamQuery.Shared.Test
dotnet pack -o nuget shared\src\ReamQuery.Shared
dotnet restore query
dotnet test query\test\ReamQuery.Test
```

SQL scripts for supported DB providers can be found in `sql` and must be run prior to running the tests.
Connection strings must be .NET syntax and are passed by the following environment variables:

 - `REAMQUERY_WORLDDB_SQLSERVER`
 - `REAMQUERY_TYPETEST_SQLSERVER`
 - `REAMQUERY_WORLDDB_NPGSQL`

Unset values will cause dependent tests to not run.

 ### Todo
 - Code only queries
 - SQLite
<commit_msg>TODO completed<commit_after>## .NET Core backend for the [Ream editor](https://github.com/stofte/ream-editor) [![Windows build status](https://ci.appveyor.com/api/projects/status/7p2pha3iiaomihr4?svg=true)](https://ci.appveyor.com/project/stofte/ream-query) [![Linux build Status](https://travis-ci.org/stofte/ream-query.svg?branch=master)](https://travis-ci.org/stofte/ream-query)

A nuget package must be used in order for the shared code to be loadable in a test context.
If updating shared, be sure to clear the nuget cache (%USERPROFILE%\\.nuget)

```
dotnet restore shared
dotnet test shared\test\ReamQuery.Shared.Test
dotnet pack -o nuget shared\src\ReamQuery.Shared
dotnet restore query
dotnet test query\test\ReamQuery.Test
```

SQL scripts for supported DB providers can be found in `sql` and must be run prior to running the tests.
Connection strings must be .NET syntax and are passed by the following environment variables:

 - `REAMQUERY_WORLDDB_SQLSERVER`
 - `REAMQUERY_TYPETEST_SQLSERVER`
 - `REAMQUERY_WORLDDB_NPGSQL`

Unset values will cause dependent tests to not run.

{'fraction_non_alphanumeric': 0.10599909788001805, 'fraction_numerical': 0.0036084799278304014, 'mean_word_length': 4.93048128342246, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 10, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '580229', 'n_tokens_mistral': 717, 'n_tokens_neox': 708, 'n_words': 220}