<commit_before># STRING Functions

All C99 functions except strxfrm and strerror.
the functions bcmp, rindex, index, bzero, and bcopy are specified in 4.3BSD.
Below is a list of all string functions present in LibFalcon.

========= ========
Function   Spec
========= ========
bcmp      4.3BSD
bcopy     4.3BSD
bzero     4.3BSD
index     4.3BSD
memchr    C99
memcmp    C99
memcpy    C99
memmove   C99
memset    C99
rindex    4.3BSD
strcat    C99
strchr    C99
strcmp    C99
strcoll   C99
strcpy    C99
strcspn   C99
strlen    C99
strncat   C99
strncmp   C99
strncpy   C99
strnlen   C99
strpbrk   C99
strrchr   C99
strspn    C99
strstr    C99
strtok    C99
========= ========<commit_msg>Updated Documentation.<commit_after># STRING Functions

All C99 functions except strxfrm and strerror.
Below is a list of all string functions present in LibFalcon.

=========+========+=====+=======+=====+==============+==============
Function + 4.3BSD + C99 + SVr4  + C89 + POSIX.1-2001   POSIX.1-2001
=========+========+=====+=======+=====+==============+==============
bcmp      Yes       No    Yes     Yes       Yes             ??      
bcopy     Yes       No    ??      ??        ??              ??      
bzero     Yes       No    ??      ??        ??              ??      
index     Yes       No    ??      ??        ??              ??      
memchr    Yes       Yes   Yes     Yes       Yes             ??      
memcmp    Yes       Yes   Yes     Yes       Yes             ??      
memcpy    Yes       Yes   Yes     Yes       Yes             ??      
memmove   Yes       Yes   Yes     Yes       Yes             ??      
memset    Yes       Yes   Yes     Yes       Yes             ??      
rindex    Yes       No    ??      ??        ??              ??      
swab      Yes       ??    Yes     ??        Yes             ??      
strcat    Yes       Yes   Yes     Yes       ??              ??      
strchr    Yes       Yes   Yes     Yes       ??              ??      
strcmp    Yes       Yes   Yes     Yes       ??              ??      
strcoll   Yes       Yes   Yes     Yes       ??              ??      
strcpy    Yes       Yes   Yes     Yes       ??              ??      
strcspn   Yes       Yes   Yes     Yes       ??              ??      
strlen    Yes       Yes   Yes     Yes       ??              ??      
strncat   Yes       Yes   Yes     Yes       ??              ??      
strncmp   Yes       Yes   Yes     Yes       ??              ??      
strncpy   Yes       Yes   Yes     Yes       ??              ??      
strnlen   ??        ??    ??      ??        ??              Yes     
strpbrk   Yes       No    Yes     Yes       ??              ??      
strrchr   Yes       Yes   Yes     Yes       ??              ??      
strspn    Yes       Yes   Yes     Yes       ??              ??      
strstr    ??        Yes   ??      Yes       ??              ??      
strtok    Yes       Yes   Yes     Yes       Yes             ??      
=========+========+=====+=======+=====+==============+==============
{'fraction_non_alphanumeric': 0.13755020080321284, 'fraction_numerical': 0.025100401606425703, 'mean_word_length': 0.9807819748177601, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 6, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '7354975', 'n_tokens_mistral': 884, 'n_tokens_neox': 819, 'n_words': 244}