<commit_before># XML Schema Content Extractor
xml-schema-content-extractor takes data component documentation and facets in XML Schema and represents it in a JSON data format.

## Get Started

  1. Run bash script `./bin/extract-content.sh`.

    example: 
    
      `bash ./bin/extract-content.sh ./data/xml-schema/domain-x/type.xsd | tee ./data/extraction/domain-x/type.xsd-content.json`
      
## Optional Batch Configuration
The bash script `./bin/create-filtered-xml-schema-json-file-list.sh` creates a JSON listing of input XML Schema files.  It may require modification of paths to input XML Schema and XSLT processor.  

After modifying it for your environment, execute the bash script:

  `bash ./bin/create-filtered-xml-schema-json-file-list.sh`

A JSON listing is created in file `xml-schema-file-list.json`. 

## Compile XSLT Change
XSLT changes require compilation when using the xml-schema-content-extractor bash script.  

Compile stylesheet changes by running the provided compile-xslt bash script.  

(Note: The xml-schema-content-extractor bash script applies a compiled stylesheet although it may be modified to apply an uncompiled stylesheet.)

# Authoritative Sources

The authoritative and complete work is maintained on [GitHub](https://github.com/gmoyanollc/xml-schema-content-extractor).

[<NAME>](https://onename.com/gmoyano)
@github/gmoyanollc
modified: May 10 2018<commit_msg>readme update<commit_after># XML Schema Content Extractor
xml-schema-content-extractor takes data component documentation and facets from XML Schema and represents it in a JSON data format.  The JSON data may used to reference a data component's documentation and facets for JSON schema development.

## Get Started
xml-schema-content-extractor may be run either as a bash script or NodeJS script.

  * Run bash script for usage: `./bin/extract-content.sh`.

     JSON data is sent to standard output and may be directed to a file for stand-alone runs.

  or

  * Run NodeJS script for usage: `node app.js`.

    JSON data is sent to the folder provided by an argument.
      
## Optional Batch Configuration
The bash script `./bin/create-xml-schema-file-list.sh` creates a JSON listing of input XML Schema files. 

  * Run bash script for usage: `./bin/create-xml-schema-file-list.sh`

A JSON listing is created in a file named `xml-schema-file-list.json`. 

## Compile XSLT Change
XSLT changes may be compiled.  Compile stylesheet changes by running the provided `compile-xslt` bash script.  

# Authoritative Sources

The authoritative and complete work is maintained on [GitHub](https://github.com/gmoyanollc/xml-schema-content-extractor).

[<NAME>](https://onename.com/gmoyano)
@github/gmoyanollc
modified: Jun 28 2018
{'fraction_non_alphanumeric': 0.08394428152492668, 'fraction_numerical': 0.004765395894428153, 'mean_word_length': 3.952813067150635, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 5, 'https://': 4, 'lorem ipsum': 0, 'www.': 0, 'xml': 14}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1804153', 'n_tokens_mistral': 817, 'n_tokens_neox': 751, 'n_words': 307}