<commit_before>rsync_solid_to_cluster.sh
=========================

Interactive script to semi-automate the transfer of data from the SOLiD
instrument to a destination machine.

Usage:

    rsync_solid_to_cluster.sh <local_dir> <user>@<remote_host>:<remote_dir>

`<local_dir>` is the directory to be copied; `<user>` is an account on the
destination machine `<remote_host>` and `<remote_dir>` is the parent directory
there where a copy of `<local_dir>` will be made.

The script operates interactively and prompts the user at each step to
confirm each action:

1. Check that the information is correct
2. Do "rsync --dry-run" and inspect the output
3. Perform the actual rsync operation
4. Check that the local and remote file sizes match
5. Remove group write permissions from the remote copy<commit_msg>solid2cluster README: some more minor formatting updates.<commit_after>rsync_solid_to_cluster.sh
=========================

Interactive script to semi-automate the transfer of data from the SOLiD
instrument to a destination machine.

Usage:

    rsync_solid_to_cluster.sh <local_dir> <user>@<remote_host>:<remote_dir>

`<local_dir>` is the directory to be copied; `<user>` is an account on the
destination machine `<remote_host>` and `<remote_dir>` is the parent directory
where a copy of `<local_dir>` will be made.

The script operates interactively and prompts the user at each step to
confirm each action:

1. Check that the information is correct
2. Do `rsync --dry-run` and inspect the output
3. Perform the actual rsync operation
4. Check that the local and remote file sizes match
5. Remove group write permissions from the remote copy

{'fraction_non_alphanumeric': 0.09338993329290479, 'fraction_numerical': 0.0066707095209217705, 'mean_word_length': 5.156716417910448, 'pattern_counts': {'":': 0, '<': 21, '<?xml version=': 0, '>': 21, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '944616', 'n_tokens_mistral': 474, 'n_tokens_neox': 452, 'n_words': 218}