<commit_before># Koldfish Data Acquisition Module
The KoLDfish data aquisition module, offers a simple API for fast access to the Linked Open Data cloud.
It provides a Java API, a simple implementation for it as well as a simple crawler for linked data.

## Overview
The project contains a framework for accessing RDF by dereferencing URIs and a lightweight crawler based upon that.

## Setup
Download the code from [github](https://github.com/lkastler/koldfish-dam) and execute maven with `maven install`.

## Usage
- For Java-based implementations look into the [Java API description](api_java.md).

## Used Projects
In koldfish-dam, we use the following dependencies:
- [Apache Jena](http://jena.apache.org) for retrieving and parsing RDF data (Apache 2.0 Lisence).
- [Google Guava](https://github.com/google/guava) for improved concurrent processes (Apache 2.0 Lisence).
- [SLF4J](http://www.slf4j.org/) for logging (MIT License).
- uk.com.robust-it cloning for deep cloning (Apache 2.0 Lisence).<commit_msg>changed documentation from slf4j to log4j<commit_after># Koldfish Data Acquisition Module
The KoLDfish data aquisition module, offers a simple API for fast access to the Linked Open Data cloud.
It provides a Java API, a simple implementation for it as well as a simple crawler for linked data.

## Overview
The project contains a framework for accessing RDF by dereferencing URIs and a lightweight crawler based upon that.

## Setup
Download the code from [github](https://github.com/lkastler/koldfish-dam) and execute maven with `maven install`.

## Usage
- For Java-based implementations look into the [Java API description](api_java.md).

## Used Projects
In koldfish-dam, we use the following dependencies:
- [Apache Jena](http://jena.apache.org) for retrieving and parsing RDF data (Apache 2.0 Lisence).
- [Google Guava](https://github.com/google/guava) for improved concurrent processes (Apache 2.0 Lisence).
- [Log4j 2.x](logging.apache.org/log4j/2.x/) for logging (Apache 2.0 License).
- uk.com.robust-it cloning for deep cloning (Apache 2.0 Lisence).
{'fraction_non_alphanumeric': 0.0907774022211492, 'fraction_numerical': 0.010622887493964268, 'mean_word_length': 4.584905660377358, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 4, 'lorem ipsum': 0, 'www.': 1, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6999332', 'n_tokens_mistral': 630, 'n_tokens_neox': 587, 'n_words': 256}