<commit_before>---
layout: default
title : s3fs-fuse
tagline: Using S3 Fuse to mount S3 storage
header : Using S3 fuse 
---
{% include JB/setup %}

s3fs-fuse mounts your OSiRIS S3 buckets as a regular filesystem (File System in User Space - FUSE).  Using it requires that your system have appropriate packages for FUSE installed:  fuse, fuse-libs, or libfuse on Debian based distributions of linux.  

On Mac OSX you can use Homebrew to install s3fs and the fuse dependency.  

Detailed instructions for installation or compilation are available from the s3fs Github site:  
<a href="https://github.com/s3fs-fuse/s3fs-fuse">https://github.com/s3fs-fuse/s3fs-fuse</a>

s3fs-fuse does not require any dedicated S3 setup or data format.  It can be used in combination with any other S3 compatible client.  

<h2>OSiRIS s3fs bundle</h2>

Linux users have the option of using our s3fs bundle.  The bundle includes s3fs packaged with AppImage so it will work on any Linux distribution.  It also includes a setup script and wrapper script that passes all the correct parameters to s3fuse for mounting.   The wrapper will automatically mount all of your buckets or allow you to specify a single one, and it can also create a new bucket for you.  

The latest release is available for <a href="https://github.com/MI-OSiRIS/osiris-bundle/releases/latest/download/osiris-bundle.tgz">download from our Github site</a>.

<h3>Example s3fs bundle usage:</h3>

Download the bundle:

    curl -L --output osiris-bundle.tgz \
    https://github.com/MI-OSiRIS/osiris-bundle/releases/latest/download/osiris-bundle.tgz

Untar into your home directory:
<commit_msg>Update s3fuse.md<commit_after>---
layout: default
title : s3fs-fuse
tagline: Using S3 Fuse to mount S3 storage
header : Using S3 fuse 
---
{% include JB/setup %}

s3fs-fuse mounts your OSiRIS S3 buckets as a regular filesystem (File System in User Space - FUSE).  Using it requires that your system have appropriate packages for FUSE installed:  fuse, fuse-libs, or libfuse on Debian based distributions of linux.  

On Mac OSX you can use Homebrew to install s3fs and the fuse dependency.  

Detailed instructions for installation or compilation are available from the s3fs Github site:  
<a href="https://github.com/s3fs-fuse/s3fs-fuse">https://github.com/s3fs-fuse/s3fs-fuse</a>

s3fs-fuse does not require any dedicated S3 setup or data format.  It can be used in combination with any other S3 compatible client.  

*The s3fs-fuse mount location must not be mounted on a Spectrum Scale (GPFS) mount, like /mnt/home on MSU's HPCC.*

<h2>OSiRIS s3fs bundle</h2>

Linux users have the option of using our s3fs bundle.  The bundle includes s3fs packaged with AppImage so it will work on any Linux distribution.  It also includes a setup script and wrapper script that passes all the correct parameters to s3fuse for mounting.   The wrapper will automatically mount all of your buckets or allow you to specify a single one, and it can also create a new bucket for you.  

The latest release is available for <a href="https://github.com/MI-OSiRIS/osiris-bundle/releases/latest/download/osiris-bundle.tgz">download from our Github site</a>.

<h3>Example s3fs bundle usage:</h3>

Download the bundle:

    curl -L --output osiris-bundle.tgz \
    https://github.com/MI-OSiRIS/osiris-bundle/releases/latest/download/osiris-bundle.tgz

Untar into your home directory:

{'fraction_non_alphanumeric': 0.07312775330396476, 'fraction_numerical': 0.014684287812041116, 'mean_word_length': 3.986822840409956, 'pattern_counts': {'":': 0, '<': 19, '<?xml version=': 0, '>': 19, 'https://': 8, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 8, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1271301', 'n_tokens_mistral': 1075, 'n_tokens_neox': 1023, 'n_words': 444}