<commit_before>ntto
====

[![Project Status: Inactive – The project has reached a stable, usable state but is no longer being actively developed; support/maintenance will be provided as time allows.](https://www.repostatus.org/badges/latest/inactive.svg)](https://www.repostatus.org/#inactive)

Minimal n-triples toolkit. It can:

* shrink n-triples by applying namespace abbreviations (given some rules)
* convert n-triples to line delimited JSON (.ldj)

[![Build Status](http://img.shields.io/travis/miku/ntto.svg?style=flat)](https://travis-ci.org/miku/ntto)

To list the abbreviation rules, run:

    $ ntto -d

To create an abbreviated NT file from an NT file, run:

    $ ntto -o OUTPUT.NT -a FILE.nt

To create an abbreviated JSON file from an NT file, run:

    $ ntto -a -j FILE.nt > OUTPUT.LDJ

To create an abbreviated JSON file from an NT file while ignoring conversion errors, run:

    $ ntto -a -j -i FILE.nt > OUTPUT.LDJ

To create an abbreviated JSON file from an NT file while ignoring conversion errors and using a custom RULES file, run:

    $ ntto -r RULES -a -j -i FILE.nt > OUTPUT.LDJ

Installation
------------

RPM and DEB packages can be found under [releases](https://github.com/miku/ntto/releases).
<commit_msg>remove travis badge<commit_after>ntto
====

[![Project Status: Inactive – The project has reached a stable, usable state but is no longer being actively developed; support/maintenance will be provided as time allows.](https://www.repostatus.org/badges/latest/inactive.svg)](https://www.repostatus.org/#inactive)

Minimal n-triples toolkit. It can:

* shrink n-triples by applying namespace abbreviations (given some rules)
* convert n-triples to line delimited JSON (.ldj)

To list the abbreviation rules, run:

    $ ntto -d

To create an abbreviated NT file from an NT file, run:

    $ ntto -o OUTPUT.NT -a FILE.nt

To create an abbreviated JSON file from an NT file, run:

    $ ntto -a -j FILE.nt > OUTPUT.LDJ

To create an abbreviated JSON file from an NT file while ignoring conversion errors, run:

    $ ntto -a -j -i FILE.nt > OUTPUT.LDJ

To create an abbreviated JSON file from an NT file while ignoring conversion errors and using a custom RULES file, run:

    $ ntto -r RULES -a -j -i FILE.nt > OUTPUT.LDJ

Installation
------------

RPM and DEB packages can be found under [releases](https://github.com/miku/ntto/releases).

{'fraction_non_alphanumeric': 0.10550651534258092, 'fraction_numerical': 0.0, 'mean_word_length': 3.507575757575758, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 9, 'https://': 7, 'lorem ipsum': 0, 'www.': 4, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6448771', 'n_tokens_mistral': 797, 'n_tokens_neox': 731, 'n_words': 300}