<commit_before># Unicode v<%= version %> data

JavaScript-compatible Unicode data for use in Node.js. Included: arrays of code points, arrays of symbols, and regular expressions for Unicode v<%= version %>’s categories, scripts, blocks, and properties.

The data files in this module are generated as part of the [node-unicode-data](http://mths.be/node-unicode-data) project.

## Installation

```bash
npm install unicode-<%= version %> --save
```

## Usage

```js
// Get an array of code points in a given Unicode category:
var codePoints = require('unicode-<%= version %>/categories/Lu/code-points');
// Get an array of symbols (strings) in a given Unicode category:
var symbols = require('unicode-<%= version %>/categories/Lu/symbols');
// Get a regular expression that matches any symbol in a given Unicode category:
var regex = require('unicode-<%= version %>/categories/Lu/regex');
// Get the canonical category a given code point belongs to:
// (Note: U+0041 is LATIN CAPITAL LETTER A)
var category = require('unicode-6.3.0/categories')[ 0x41 ];
// Get the directionality of a given code point:
var directionality = require('unicode-6.3.0/properties/bidi')[ 0x41 ];
// What glyph is the mirror image of `«` (U+00AB)?
var mirrored = require('unicode-6.3.0/bidi-mirroring')[ 0xAB ];
// …you get the idea.
```

Other than categories, data on Unicode properties, blocks, and scripts is available too (for recent versions of the Unicode standard). Here’s the full list of the available data for v<%= version %>:

```js
<% Object.keys(dirs).forEach(function(type) { %>// <%= type %>:
<%
	if (/^(?:bidi-mirroring|properties|categories)$/.test(type)) {
		var extra = type == 'properties' ? '/bidi' : '';
%>
require('unicode-<%= version %>/<%= type %><%= extra %>');
<%
	}
	dirs[type].forEach(function(dir) {
%>
require('unicode-<%= version %>/<%= type %>/<%= dir %>/code-points');
require('unicode-<%= version %>/<%= type %>/<%= dir %>/symbols');
require('unicode-<%= version %>/<%= type %>/<%= dir %>/regex');
<%
	});
});
%>
```

## Author

| [![twitter/mathias](http://gravatar.com/avatar/24e08a9ea84deb17ae121074d0f17125?s=70)](http://twitter.com/mathias "Follow @mathias on Twitter") |
|---|
| [<NAME>](http://mathiasbynens.be/) |

## License

This module is available under the [MIT](http://mths.be/mit) license.<commit_msg>Tweak whitespace in template-based output<commit_after># Unicode v<%= version %> data

JavaScript-compatible Unicode data for use in Node.js. Included: arrays of code points, arrays of symbols, and regular expressions for Unicode v<%= version %>’s categories, scripts, blocks, and properties.

The data files in this module are generated as part of the [node-unicode-data](http://mths.be/node-unicode-data) project.

## Installation

```bash
npm install unicode-<%= version %> --save
```

## Usage

```js
// Get an array of code points in a given Unicode category:
var codePoints = require('unicode-<%= version %>/categories/Lu/code-points');
// Get an array of symbols (strings) in a given Unicode category:
var symbols = require('unicode-<%= version %>/categories/Lu/symbols');
// Get a regular expression that matches any symbol in a given Unicode category:
var regex = require('unicode-<%= version %>/categories/Lu/regex');
// Get the canonical category a given code point belongs to:
// (Note: U+0041 is LATIN CAPITAL LETTER A)
var category = require('unicode-6.3.0/categories')[ 0x41 ];
// Get the directionality of a given code point:
var directionality = require('unicode-6.3.0/properties/bidi')[ 0x41 ];
// What glyph is the mirror image of `«` (U+00AB)?
var mirrored = require('unicode-6.3.0/bidi-mirroring')[ 0xAB ];
// …you get the idea.
```

Other than categories, data on Unicode properties, blocks, and scripts is available too (for recent versions of the Unicode standard). Here’s the full list of the available data for v<%= version %>:

```js<% Object.keys(dirs).forEach(function(type) { %>
// <%= type.replace(/-/g, ' ') %>:
<%
	if (/^(?:bidi-mirroring|properties|categories)$/.test(type)) {
		var extra = type == 'properties' ? '/bidi' : '';
%>
require('unicode-<%= version %>/<%= type %><%= extra %>');
<%
	}
	dirs[type].forEach(function(dir) {
%>
require('unicode-<%= version %>/<%= type %>/<%= dir %>/code-points');
require('unicode-<%= version %>/<%= type %>/<%= dir %>/symbols');
require('unicode-<%= version %>/<%= type %>/<%= dir %>/regex');
<%
	});
});
%>```

## Author

| [![twitter/mathias](http://gravatar.com/avatar/24e08a9ea84deb17ae121074d0f17125?s=70)](http://twitter.com/mathias "Follow @mathias on Twitter") |
|---|
| [<NAME>](http://mathiasbynens.be/) |

## License

This module is available under the [MIT](http://mths.be/mit) license.
{'fraction_non_alphanumeric': 0.1863037005529562, 'fraction_numerical': 0.019140791152700978, 'mean_word_length': 4.526439482961222, 'pattern_counts': {'":': 0, '<': 53, '<?xml version=': 0, '>': 53, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '7178931', 'n_tokens_mistral': 1656, 'n_tokens_neox': 1466, 'n_words': 469}