<commit_before>==== BSBM-Jena

Berlin SPARQL Benchmark with additions for testing Jena local stores.

Adds new endpoint formats:

* "jena:assembler" where "assembler" is the file name of a Jena assembler
description for the store.

* "sesame:directory" to connect to a Seame repository.


== Get the system and setup

git clone git://github.com/afs/BSBM-Local.git
mkdir Data
mkdir src-test

# Get the dependent jars
ivy -settings ivysettings.xml -ivy ivy.xml \
    -retrieve 'lib-sys/[artifact]-[revision](-[classifier]).[ext]' \
    -sync retrieve


# Compile the system
ant jar

Either use Eclipse (the project setup is included) or use "ant jar" which
places the jar in build/.

==  Directories

Data/data-SIZE          -- generated data
TDB-DB/DB-SIZE/         -- TDB 
Sesame-DB/Repo-SIZE     -- Sesame

== Process - for TDB backed stores.

# Choose sizes wanted
genAll

# Run the tdbloader, create stats files and assembler files.           
loadAll 

# Run the performance tests
# Results go into "Results/"
runPerf

# Generate the results, naming the results directory.
# NB The BSBM formatter knows the possible store sizes 
runResults Results 

== Process - Sesame

loadSesame	
runPerfSesame

== Questions?

If about BSBM generaly, ask the authors, see 
http://www4.wiwiss.fu-berlin.de/bizer/BerlinSPARQLBenchmark/

If about teh Jena customization, please send questions to:

    <EMAIL>
<commit_msg>Update notes<commit_after>==== BSBM-Jena

Berlin SPARQL Benchmark with additions for testing local stores.  BSBM runs
all the queries over the SPARQL Protocol whereas this version calls the
stores directly, so removing protocol overhead.  For the smaller datasets
and simpler queries, the overheads can be a significant part of the cost so
evaluation of stores can be skewed.

BSBM-Local adds new endpoint formats as pseudo-URI schemes:

* "jena:<assembler>" where "assembler" is the file name of a Jena assembler
description for the store.

* "sesame:<directory>" to connect to a Sesame repository.

== Get the system and setup

git clone git://github.com/afs/BSBM-Local.git
# Create directories.
mkdir Data TDB-DB Sesame-DB
mkdir src-test

# The dependent jars.
mkdir lib-sys

# Get the dependent jars
ivy -settings ivysettings.xml -ivy ivy.xml \
    -retrieve 'lib-sys/[artifact]-[revision](-[classifier]).[ext]' \
    -sync retrieve

# Compile the system
ant jar

Either use Eclipse (the project setup is included) or use "ant jar" which
places the jar in build/.

==  Directories

Data/data-SIZE          -- generated data
TDB-DB/DB-SIZE/         -- TDB 
Sesame-DB/Repo-SIZE     -- Sesame

== Process - for TDB backed stores.

# Choose sizes wanted
genAll

# Run the tdbloader, create stats files and assembler files.           
loadAll 

# Run the performance tests
# Results go into "Results/"
runPerf

# Generate the results, naming the results directory.
# NB The BSBM formatter knows the possible store sizes 
runResults Results 

== Process - Sesame

loadSesame	
runPerfSesame

== Questions?

If about BSBM generaly, ask the authors, see 
http://www4.wiwiss.fu-berlin.de/bizer/BerlinSPARQLBenchmark/

If about the local customization, please send questions to:

    <EMAIL>

{'fraction_non_alphanumeric': 0.08171571696931747, 'fraction_numerical': 0.0006261740763932373, 'mean_word_length': 3.5254957507082154, 'pattern_counts': {'":': 0, '<': 7, '<?xml version=': 0, '>': 7, 'https://': 0, 'lorem ipsum': 0, 'www.': 2, 'xml': 4}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '40412', 'n_tokens_mistral': 1029, 'n_tokens_neox': 990, 'n_words': 385}