<commit_before># Purpose

The purpose of the Soil Organic Carbon Data Rescue and Harmonization Repository (SOC-DRaHR) is to collect haromonization scripts for data sets related to soil carbon to enable scientific research.
This project identifies soil carbon datasets that are publicly avaiable, provides data harmonization scripts to integrate those data sets, and provides output scripts for a harmonized data product.
Data can come from field surveys, field manipulation studies, and laboratory experiments.

This project is not a *data* repository or data.
End users are responsible for complying with ALL data use policies of the orginal data providers, please check with the orginal archives and reposities to ensure you are complying with use policies.

# Links to get started<commit_msg>fix typo<commit_after># Purpose

The purpose of the Soil Organic Carbon Data Rescue and Harmonization Repository (SOC-DRaHR) is to collect haromonization scripts for data sets related to soil carbon to enable scientific research.
This project identifies soil carbon datasets that are publicly avaiable, provides data harmonization scripts to integrate those data sets, and provides output scripts for a harmonized data product.
Data can come from field surveys, field manipulation studies, and laboratory experiments.

This project is not a _data_ repository or archive but instead a code repository.
End users are responsible for complying with ALL data use policies of the orginal data providers, please check with the orginal archives and reposities to ensure you are complying with use policies.

# Links to get started
{'fraction_non_alphanumeric': 0.023485784919653894, 'fraction_numerical': 0.0, 'mean_word_length': 5.299610894941634, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '390458', 'n_tokens_mistral': 362, 'n_tokens_neox': 341, 'n_words': 237}