<commit_before>---
title: About
menu: about
menu_icon: 'anchor'

shortcode-core:
    active: true
---
[section name="header"]Unitex/GramLab is an <a class="page-scroll" href="#open-source">open source</a>, <a class="page-scroll" href="#cross-platform">cross-platform</a>, <a class="page-scroll" href="#multilingual">multilingual</a>,<br><a class="page-scroll" href="#lexicon-based">lexicon-</a> and <a class="page-scroll" href="#grammar-based">grammar-based</a> <a class="page-scroll" href="#corpus-processing-suite">corpus processing suite</a>[/section]

[section name="a_image"]u.png[/section]
[section name="a_title"]Unitex[/section]
[section name="a_subtitle"]The Core <abbr title="Natural Language Processing">NLP</abbr> Engine[/section]
[section name="a_text"]Unitex is the C++ <abbr title="NLP">Natural Language Processing</abbr> engine of Unitex/GramLab. Unitex **automata-oriented technology** allows to handle electronic resources such as electronic dictionaries and grammars and apply them on a text[/section]

[section name="b_image"]lr.png[/section]
[section name="b_title"]/[/section]
[section name="b_subtitle"]The Language Resources[/section]
[section name="b_text"]Language Resources are the electronic dictionaries and grammars that power Unitex analysis on textual data. Resources for **[more than 22 languages](/language-resources?target=_blank)** are currently distributed out-of-the-box with Unitex/GramLab[/section]

[section name="c_image"]g.png[/section]
[section name="c_title"]GramLab[/section]
[section name="c_subtitle"]The Visual <abbr title="Integrated Development Environment">IDE</abbr>[/section]
[section name="c_text"]GramLab is the Visual <abbr title="IDE">Integrated Development Environment</abbr> of Unitex/GramLab. GramLab features a **rich project-oriented perspective** allowing users to work on several projects in parallel and run each of them on a single click[/section]

[section name="feature_1_image"]opensource.png[/section]
[section name="feature_1_class"]open-source[/section]
[section name="feature_1_title"]Open Source[/section]
[section name="feature_1_description"]Unitex/GramLab is freely distributed under the terms of the <a href='http://www.gnu.org/licenses/lgpl.html'>Lesser General	Public License (LGPL)</a>. This means that everyone can redistribute Unitex freely within the terms of the LGPL license. It also means that you have access to the source code of all the Unitex programs, which is included in the zip file you download. The LGPL license is more permissive than the GPL one, because it allows you to reuse the own code of Unitex/GramLab in non-free software[/section]

[section name="feature_2_image"]cross-platform.png[/section]
[section name="feature_2_class"]cross-platform[/section]
[section name="feature_2_title"]Cross-platform[/section]
[section name="feature_2_description"]The Unitex/GramLab Core NLP Engine is written in C++, the Visual IDE is written in Java. This allows to develop Unitex-based applications on any system that supports Java 1.7, compile them with any standard C++ - compliant compiler and run them on your favorite platform: Windows, Linux, MacOS, and several others[/section]

[section name="feature_3_image"]multilingual.png[/section]
[section name="feature_3_class"]multilingual[/section]
[section name="feature_3_title"]Multilingual[/section]
[section name="feature_3_description"]Unitex/GramLab conforms to the Unicode 3.0 standard that allows users to handle virtually all the characters of all languages, including Asian languages. The Unitex programs have been designed to work for all writing rules. There is no difficulty in working with Asian languages, in spite of their particular spacing conventions[/section]<commit_msg>[minor refactor] Add missing space<commit_after>---
title: About
menu: about
menu_icon: 'anchor'

shortcode-core:
    active: true
---
[section name="header"]Unitex/GramLab is an <a class="page-scroll" href="#open-source">open source</a>, <a class="page-scroll" href="#cross-platform">cross-platform</a>, <a class="page-scroll" href="#multilingual">multilingual</a>, <br><a class="page-scroll" href="#lexicon-based">lexicon-</a> and <a class="page-scroll" href="#grammar-based">grammar-based</a> <a class="page-scroll" href="#corpus-processing-suite">corpus processing suite</a>[/section]

[section name="a_image"]u.png[/section]
[section name="a_title"]Unitex[/section]
[section name="a_subtitle"]The Core <abbr title="Natural Language Processing">NLP</abbr> Engine[/section]
[section name="a_text"]Unitex is the C++ <abbr title="NLP">Natural Language Processing</abbr> engine of Unitex/GramLab. Unitex **automata-oriented technology** allows to handle electronic resources such as electronic dictionaries and grammars and apply them on a text[/section]

[section name="b_image"]lr.png[/section]
[section name="b_title"]/[/section]
[section name="b_subtitle"]The Language Resources[/section]
[section name="b_text"]Language Resources are the electronic dictionaries and grammars that power Unitex analysis on textual data. Resources for **[more than 22 languages](/language-resources?target=_blank)** are currently distributed out-of-the-box with Unitex/GramLab[/section]

[section name="c_image"]g.png[/section]
[section name="c_title"]GramLab[/section]
[section name="c_subtitle"]The Visual <abbr title="Integrated Development Environment">IDE</abbr>[/section]
[section name="c_text"]GramLab is the Visual <abbr title="IDE">Integrated Development Environment</abbr> of Unitex/GramLab. GramLab features a **rich project-oriented perspective** allowing users to work on several projects in parallel and run each of them on a single click[/section]

[section name="feature_1_image"]opensource.png[/section]
[section name="feature_1_class"]open-source[/section]
[section name="feature_1_title"]Open Source[/section]
[section name="feature_1_description"]Unitex/GramLab is freely distributed under the terms of the <a href='http://www.gnu.org/licenses/lgpl.html'>Lesser General	Public License (LGPL)</a>. This means that everyone can redistribute Unitex freely within the terms of the LGPL license. It also means that you have access to the source code of all the Unitex programs, which is included in the zip file you download. The LGPL license is more permissive than the GPL one, because it allows you to reuse the own code of Unitex/GramLab in non-free software[/section]

[section name="feature_2_image"]cross-platform.png[/section]
[section name="feature_2_class"]cross-platform[/section]
[section name="feature_2_title"]Cross-platform[/section]
[section name="feature_2_description"]The Unitex/GramLab Core NLP Engine is written in C++, the Visual IDE is written in Java. This allows to develop Unitex-based applications on any system that supports Java 1.7, compile them with any standard C++ - compliant compiler and run them on your favorite platform: Windows, Linux, MacOS, and several others[/section]

[section name="feature_3_image"]multilingual.png[/section]
[section name="feature_3_class"]multilingual[/section]
[section name="feature_3_title"]Multilingual[/section]
[section name="feature_3_description"]Unitex/GramLab conforms to the Unicode 3.0 standard that allows users to handle virtually all the characters of all languages, including Asian languages. The Unitex programs have been designed to work for all writing rules. There is no difficulty in working with Asian languages, in spite of their particular spacing conventions[/section]
{'fraction_non_alphanumeric': 0.11582599412863624, 'fraction_numerical': 0.004803843074459567, 'mean_word_length': 6.774896265560166, 'pattern_counts': {'":': 0, '<': 49, '<?xml version=': 0, '>': 49, 'https://': 0, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 6, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '4100968', 'n_tokens_mistral': 2200, 'n_tokens_neox': 2071, 'n_words': 728}