<commit_before>The Fusepool Enhanced Content Store
=====

This is the module for storing and searching for binary content.

Uploading a content works like this:

$ curl -X POST -u "admin:admin" -H "Content-Type: text/plain" -d
@council_of_europe.txt http://localhost:8080/ecs/

of for a pdf

$ curl -X POST -u "admin:admin" -H "Content-Type: application/pdf" --data-binary
@concil_of_urope.pdf http://localhost:8080/ecs/

The response will look like this

Posted 499 bytes, with uri
<http://localhost:8080/ecs/content/ebaa4a3277f3299cb3fd9e69367f2c4a>:
text/plain

At the specified URI the content can be dereferenced. Adding ".meta"
to the URI will dereference to the rdf describing the resource in the
content graph. (Note that this is not the full RDF produced by the
enhancer. This RDF is stored in a graph named:<commit_msg>fixed Readme to describe Link-Header rather tha URI assembly<commit_after>The Fusepool Enhanced Content Store
=====

This is the module for storing and searching for binary content.

Uploading a content works like this:

$ curl -X POST -u "admin:admin" -H "Content-Type: text/plain" -d
@council_of_europe.txt http://localhost:8080/ecs/

of for a pdf

$ curl -X POST -u "admin:admin" -H "Content-Type: application/pdf" --data-binary
@concil_of_urope.pdf http://localhost:8080/ecs/

The response will look like this

Posted 499 bytes, with uri
<http://localhost:8080/ecs/content/ebaa4a3277f3299cb3fd9e69367f2c4a>:
text/plain

At the specified URI the content can be dereferenced. On dereferencng the resource
a Link-header like

    Lin: <http://localhost:8080/ecs/content/ebaa4a3277f3299cb3fd9e69367f2c4a.meta>; rel=meta

will point to the rdf describing the resource in the
content graph. (Note that this is not the full RDF produced by the
enhancer. This RDF is stored in a graph named:
{'fraction_non_alphanumeric': 0.0881057268722467, 'fraction_numerical': 0.048458149779735685, 'mean_word_length': 4.4894259818731115, 'pattern_counts': {'":': 0, '<': 6, '<?xml version=': 0, '>': 6, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '4679468', 'n_tokens_mistral': 652, 'n_tokens_neox': 587, 'n_words': 226}