<commit_before># Platform compiler details

You should use this list when you consider using C++ features introduced in C++14 and later.
Some features are special cases and quite ugly. Beware.

## Compiler versions and workarounds

| Platform         | Compiler name       | Compiler version |Notes             |
|:-----------------|--------------------:|:-----------------|:-----------------|
|Apple iOS         | Clang               | 3.4.0+           |Workaround #2     |
|Apple OS X        | Clang               | 3.4.0+           |Workaround #1     |
|Emscripten        | emcc                | 1.37.0+          |                  |
|Native Client     | Clang               | 3.7.0+           |                  |
|Raspberry Pi      | GCC                 | 4.9.3            |                  |
|SteamOS           | GCC                 | 4.8.1            |                  |
|Ubuntu            | GCC                 | 5.4.0+           |                  |
|Ubuntu (alt.)     | Clang               | 3.8.0+           |                  |
|Windows (Win32)   | MSVC++              | 14.0             |                  |
|Windows (UWP)     | MSVC++              | 14.0             |                  |
|                  |                     |                  |                  |
|                  |                     |                  |                  |
|                  |                     |                  |                  |
|                  |                     |                  |                  |
|                  |                     |                  |                  |
|                  |                     |                  |                  |
|                  |                     |                  |                  |

## Platform workarounds

| #    | Notes                                                 |
|:-----|:------------------------------------------------------|
| 1    | Replaces thread_local with __thread                   |
| 2    | Removes usage of thread_local, __thread not supported |<commit_msg> - Add some extra information about __thread keyword<commit_after># Platform compiler details

You should use this list when you consider using C++ features introduced in C++14 and later.
Some features are special cases and quite ugly. Beware.

## Compiler versions and workarounds

| Platform         | Compiler name       | Compiler version |Notes             |
|:-----------------|--------------------:|:-----------------|:-----------------|
|Apple iOS         | Clang               | 3.4.0+           |Workaround #2     |
|Apple OS X        | Clang               | 3.4.0+           |Workaround #1     |
|Emscripten        | emcc                | 1.37.0+          |                  |
|Native Client     | Clang               | 3.7.0+           |                  |
|Raspberry Pi      | GCC                 | 4.9.3            |                  |
|SteamOS           | GCC                 | 4.8.1            |                  |
|Ubuntu            | GCC                 | 5.4.0+           |                  |
|Ubuntu (alt.)     | Clang               | 3.8.0+           |                  |
|Windows (Win32)   | MSVC++              | 14.0             |                  |
|Windows (UWP)     | MSVC++              | 14.0             |                  |
|                  |                     |                  |                  |
|                  |                     |                  |                  |
|                  |                     |                  |                  |
|                  |                     |                  |                  |
|                  |                     |                  |                  |
|                  |                     |                  |                  |
|                  |                     |                  |                  |

## Platform workarounds

| #    | Notes                                                        |
|:-----|:-------------------------------------------------------------|
| 1    | Replaces thread_local with __thread, only supports POD types |
| 2    | Removes usage of thread_local, __thread not supported        |
{'fraction_non_alphanumeric': 0.14346895074946467, 'fraction_numerical': 0.018558172733761598, 'mean_word_length': 0.49448986846782794, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 55, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1263106', 'n_tokens_mistral': 994, 'n_tokens_neox': 858, 'n_words': 205}