<commit_before># /bin/sh

if [ "$1" = "-h" ]; then
  cat << HERE
USAGE: $0 [-h] DIRECTORIES and/or FILES

The purpose of this script is to back up whatever files are given to
it as argument. These files may be on local or remote servers. 

The script starts by rsyncing all files specified in ~/.cron_backup
It then checks to see if the file matches any other versions contained
in the ARCHIVE folder. If it does not, the script puts a copy of the 
file in ARCHIVE with the date that file was last modified as extension. 

For a less storage hungry implementation the script should be rewritten
to use git and just commit changes after every rsync. 
HERE

  exit 0 
fi


BACKUP=
ARCHIVE=

#Expected input is all files specified in ~/.cron_backup <commit_msg>Modify help statement for backUp.sh<commit_after># /bin/sh

if [ "$1" = "-h" ]; then
  cat << HERE
USAGE: $0 [-h] DIRECTORIES and/or FILES

The purpose of this script is to back up whatever files are given to
it as argument. These files may be on local or remote servers. 

This script works best in conjunction with the cron task scheduler. 
Simply create a textfile containing the full file pathnames (preceded
by the hostname if file is on a remote server) of whatever needs 
to be backed up. Then schedule a cron job that calls this script
with an argument of \$(cat filename).

The script is written such that filename expansion may be
used to specify many files at once ( *, {...}, etc.)

The script starts by rsyncing all files given to it as argument to BACKUP. 
It then checks to see if the file matches any other versions contained
in the ARCHIVE folder. If it does not, the script puts a copy of the 
file in ARCHIVE with the date that file was last modified as extension. 

For a less storage hungry implementation the script should be rewritten
to use git and just commit changes after every rsync. 
HERE

  exit 0 
fi


BACKUP=
ARCHIVE=

#Expected input is all files specified in ~/.cron_backup 
{'fraction_non_alphanumeric': 0.04931367564819522, 'fraction_numerical': 0.003050330452465684, 'mean_word_length': 3.708133971291866, 'pattern_counts': {'":': 0, '<': 7, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2753276', 'n_tokens_mistral': 556, 'n_tokens_neox': 536, 'n_words': 331}