<commit_before>Navigator Optimizer Anonymizer
========
--------------------------------------------------------
IMPORTANT: This is a BETA version of the Anonymizer tool, which is still undergoing testing before its official release. Data redaction is not 100% so do not use Anonymizer in production settings or on production data. Currently, Anonymizer is offered for testing purposes only.
---------------------------------------
Anonymizer is a command-line tool designed to be used in conjunction with [Cloudera Navigator Optimizer] (http://www.cloudera.com/products/cloudera-navigator-optimizer.html), which is a service you can use to profile and analyze the query text in SQL workloads. Use Anonymizer to protect sensitive information in the SQL workloads you analyze by using AES-128 encryption. Run Anonymizer on SQL files (.csv or semicolon-separated .sql files) to:

* Mask all literals in the SQL queries
* Encrypt table and column names

Continue reading:

* [Prerequisites](#prerequisites)
* [Using Anonymizer](#usinganonymizer)
* [Anonymization Scenarios](#anonscenarios)
* [How Anonymizer Is Used with Navigator Optimizer](#howanonusedwithnavopt)
* [CLI Reference](#cliref)
* [Limitations](#limitations)
* [FAQs](#faqs)

<a name="prerequisites" />
## Prerequisites
</a>
* Make sure that you have a recent version of the Java JDK installed. Anonymizer  has been tested with JDK 1.7 and 1.8. After installing the JDK open a terminal window and run the following command to verify it is installed correctly:<commit_msg>Updated IMPORTANT note as per <NAME><commit_after>Navigator Optimizer Anonymizer
========
--------------------------------------------------------
IMPORTANT: Anonymizer is in BETA testing before its official release. Its data redaction or masking is not guaranteed to be effective and at times it might not mask or redact sensitive information. Do not use Anonymizer in production settings or on production data. Currently, Anonymizer is offered for testing purposes only.
---------------------------------------
Anonymizer is a command-line tool designed to be used in conjunction with [Cloudera Navigator Optimizer] (http://www.cloudera.com/products/cloudera-navigator-optimizer.html), which is a service you can use to profile and analyze the query text in SQL workloads. Use Anonymizer to protect sensitive information in the SQL workloads you analyze by using AES-128 encryption. Run Anonymizer on SQL files (.csv or semicolon-separated .sql files) to:

* Mask all literals in the SQL queries
* Encrypt table and column names

Continue reading:

* [Prerequisites](#prerequisites)
* [Using Anonymizer](#usinganonymizer)
* [Anonymization Scenarios](#anonscenarios)
* [How Anonymizer Is Used with Navigator Optimizer](#howanonusedwithnavopt)
* [CLI Reference](#cliref)
* [Limitations](#limitations)
* [FAQs](#faqs)

<a name="prerequisites" />
## Prerequisites
</a>
* Make sure that you have a recent version of the Java JDK installed. Anonymizer  has been tested with JDK 1.7 and 1.8. After installing the JDK open a terminal window and run the following command to verify it is installed correctly:
{'fraction_non_alphanumeric': 0.1280332056194125, 'fraction_numerical': 0.005427841634738187, 'mean_word_length': 3.7759146341463414, 'pattern_counts': {'":': 0, '<': 8, '<?xml version=': 0, '>': 8, 'https://': 0, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '7037186', 'n_tokens_mistral': 853, 'n_tokens_neox': 799, 'n_words': 375}