<commit_before>Strings and Unicode:
--------------------

TightDB has full support for Unicode. Internally it stores all strings
using the UTF-8 character encoding.

When TightDB performs case insensitive string comparisons, it uses the
locale indenpendant case folding mechanism as described in “Caseless
Matching,” in Section 5.18, Case Mappings of the the Unicode Standard.



Date/time:
----------

TightDB supports only one date/time data type called 'Date'. A Date
value represents an absolute point it time, and is represented as an
integral non-negative number of seconds since midnight (UTC), 1
January 1970, not counting leap seconds.

Please not that it is not currently possible to store a date that
preceeds the year 1970. WE are working on an improved date/time
representation that does not have this limitation.<commit_msg>Update manual_draft.md<commit_after>Strings and Unicode:
--------------------

TightDB has full support for Unicode. Internally it stores all strings
using the UTF-8 character encoding.

When TightDB performs case insensitive string comparisons, it uses the
locale indenpendant case folding mechanism as described in “Caseless
Matching,” in Section 5.18, Case Mappings of the the Unicode Standard.



Date/time:
----------

TightDB supports only one date/time data type called 'Date'. A Date
value represents an absolute point it time, and is represented as an
integral non-negative number of seconds since midnight (UTC), 1
January 1970, not counting leap seconds.

Please note that it is not currently possible to store a date that
preceeds the year 1970. We are working on an improved date/time
representation that does not have this limitation.
{'fraction_non_alphanumeric': 0.07176749703440095, 'fraction_numerical': 0.01542111506524318, 'mean_word_length': 3.9183673469387754, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '875022', 'n_tokens_mistral': 441, 'n_tokens_neox': 392, 'n_words': 238}