<commit_before># dwca-utils

Darwin Core Archive Utils

[![Build Status](https://travis-ci.org/ansell/dwca-utils.svg?branch=master)](https://travis-ci.org/ansell/dwca-utils) [![Coverage Status](https://coveralls.io/repos/ansell/dwca-utils/badge.svg?branch=master)](https://coveralls.io/r/ansell/dwca-utils?branch=master)

# Setup

Install Maven and Git

Download the Git repository.

Set the relevant programs to be executable.

    chmod a+x ./dwcacheck
    chmod a+x ./csv2dwca

# Darwin Core Archive Checker

## Usage

Run dwcacheck with --help to get usage details:

    ./dwcacheck --help

# Darwin Core Metadata Generator

## Usage

Run csv2dwca with --help to get usage details:

    ./csv2dwca --help

# Maven

    <dependency>
        <groupId>com.github.ansell.dwca</groupId>
        <artifactId>dwca-utils</artifactId>
        <version>0.0.1</version>
    </dependency>

# Changelog

## 2016-03-29
* Add --show-defaults to allow the printing of values that should be assumed from the spec, but are not always interpreted correctly by third-parties

## 2016-03-24
* Add --extension to allow arbitrary number of extension files for the Metadata Generator in addition to a single Core file using --input

## 2016-03-23
* Release 0.0.1
* Complete the Metadata Generator 

## 2016-03-22
* Add stub for Darwin Core Metadata Generator to take CSV files and generate stub metadata.xml files
* Implement loading and some validation of metadata.xml documents

## 2016-03-21
* Initial commit<commit_msg>Note in readme about having to support meta.xml along with metadata.xml<commit_after># dwca-utils

Darwin Core Archive Utils

[![Build Status](https://travis-ci.org/ansell/dwca-utils.svg?branch=master)](https://travis-ci.org/ansell/dwca-utils) [![Coverage Status](https://coveralls.io/repos/ansell/dwca-utils/badge.svg?branch=master)](https://coveralls.io/r/ansell/dwca-utils?branch=master)

# Setup

Install Maven and Git

Download the Git repository.

Set the relevant programs to be executable.

    chmod a+x ./dwcacheck
    chmod a+x ./csv2dwca

# Darwin Core Archive Checker

## Usage

Run dwcacheck with --help to get usage details:

    ./dwcacheck --help

# Darwin Core Metadata Generator

## Usage

Run csv2dwca with --help to get usage details:

    ./csv2dwca --help

# Maven

    <dependency>
        <groupId>com.github.ansell.dwca</groupId>
        <artifactId>dwca-utils</artifactId>
        <version>0.0.1</version>
    </dependency>

# Changelog

## 2016-03-29
* Add --show-defaults to allow the printing of values that should be assumed from the spec, but are not always interpreted correctly by third-parties
* Support meta.xml along with metadata.xml for detection of the metadata file in zip files. Strange this is not standardised in the spec.

## 2016-03-24
* Add --extension to allow arbitrary number of extension files for the Metadata Generator in addition to a single Core file using --input

## 2016-03-23
* Release 0.0.1
* Complete the Metadata Generator 

## 2016-03-22
* Add stub for Darwin Core Metadata Generator to take CSV files and generate stub metadata.xml files
* Implement loading and some validation of metadata.xml documents

## 2016-03-21
* Initial commit
{'fraction_non_alphanumeric': 0.10274828232354778, 'fraction_numerical': 0.030605871330418487, 'mean_word_length': 3.6690962099125364, 'pattern_counts': {'":': 0, '<': 19, '<?xml version=': 0, '>': 19, 'https://': 8, 'lorem ipsum': 0, 'www.': 0, 'xml': 8}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '696769', 'n_tokens_mistral': 1080, 'n_tokens_neox': 972, 'n_words': 333}