<commit_before># TensorFlow OSS Filesystem Extension

OSS is an object storage service provided by Alibaba Cloud, see [here](https://www.alibabacloud.com/product/oss) for more information about the service.

This module provides an extension that emulates a filesystem using the object storage service. The directory structures are encoded in object keys and file contents are stored in objects. The extension is implemented using [OSS C SDK](https://github.com/aliyun/aliyun-oss-c-sdk).

To use the extension, first get your OSS credential from [Alibaba OSS Service](https://www.alibabacloud.com/product/oss), including:

```
OSS_HOST = your_oss_cluster_host
OSS_ACCESS_ID = your_oss_access_id
OSS_ACCESS_KEY = you_oss_access_key
OSS_BUCKET = your_oss_bucket_name<commit_msg>Update OSS FS instruction on env vars (#551)<commit_after># TensorFlow OSS Filesystem Extension

OSS is an object storage service provided by Alibaba Cloud, see [here](https://www.alibabacloud.com/product/oss) for more information about the service.

This module provides an extension that emulates a filesystem using the object storage service. The directory structures are encoded in object keys and file contents are stored in objects. The extension is implemented using [OSS C SDK](https://github.com/aliyun/aliyun-oss-c-sdk).

To use the extension, first get your OSS credential from [Alibaba OSS Service](https://www.alibabacloud.com/product/oss), including:

```
OSS_HOST=<your_oss_cluster_host>
OSS_ACCESS_ID=<your_oss_access_id>
OSS_ACCESS_KEY=<you_oss_access_key>
OSS_BUCKET=<your_oss_bucket_name>
{'fraction_non_alphanumeric': 0.07517372078332281, 'fraction_numerical': 0.0018951358180669614, 'mean_word_length': 5.947368421052632, 'pattern_counts': {'":': 0, '<': 7, '<?xml version=': 0, '>': 7, 'https://': 6, 'lorem ipsum': 0, 'www.': 4, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2984275', 'n_tokens_mistral': 479, 'n_tokens_neox': 453, 'n_words': 166}