<commit_before>RSYNC_AUR (1)             ROA-PKI                                   RSYNC_AUR(1)                                     

NAME

        rsync_aur - notifies database of files downloaded by rsync

SYNOPSIS
  
        rsync_aur -f logfile -d topDir [-t | -u | -n] -s -e -h 
            -i -w



DESCRIPTION

        The rsync_aur program reads a log prepared by the rsync program.  For
        each message in the log, it sends a message over a socket to the 
        database client to put the files obtained by rsync into the database 
        after validating them.  There are two sibling directories defined for 
        rsync, one called REPOSITORY and the other called LOGS.  Within 
        REPOSITORY are directories, one for each source used by rsync.  For 
        each such directory there is a file in LOGS that lists all the files 
        downloaded by rsync plus some other items.  The name of the log file 
        is derived from the name of the directory in REPOSITORY, e.g. directory
        "xxx" has a log file named "xxx.log".  The rsync_aur program must be 
        run from REPOSITORY.  The meanings of the parameters are:

            -f logfile specifies the path name of the log file.

            -d topDir specifies the relative path name of the directory
               being sent.

            -t specifies to use a TCP socket, or

            -u specifies to use a UDP socket, or

            -n specifies to send no messages but print them on stdout.

            -s if present, sends a special message at the end and waits for
               a response. <commit_msg>note about where the tcp/udp port is configured<commit_after>RSYNC_AUR (1)             ROA-PKI                                   RSYNC_AUR(1)                                     

NAME

        rsync_aur - notifies database of files downloaded by rsync

SYNOPSIS
  
        rsync_aur -f logfile -d topDir [-t | -u | -n] -s -e -h 
            -i -w



DESCRIPTION

        The rsync_aur program reads a log prepared by the rsync program.  For
        each message in the log, it sends a message over a socket to the 
        database client to put the files obtained by rsync into the database 
        after validating them.  There are two sibling directories defined for 
        rsync, one called REPOSITORY and the other called LOGS.  Within 
        REPOSITORY are directories, one for each source used by rsync.  For 
        each such directory there is a file in LOGS that lists all the files 
        downloaded by rsync plus some other items.  The name of the log file 
        is derived from the name of the directory in REPOSITORY, e.g. directory
        "xxx" has a log file named "xxx.log".  The rsync_aur program must be 
        run from REPOSITORY.  The meanings of the parameters are:

            -f logfile specifies the path name of the log file.

            -d topDir specifies the relative path name of the directory
               being sent.

            -t specifies to use a TCP socket (see the RPKIPort configuration
               option for the port it uses), or

            -u specifies to use a UDP socket (see RPKIPort), or

            -n specifies to send no messages but print them on stdout.

            -s if present, sends a special message at the end and waits for
               a response. 
{'fraction_non_alphanumeric': 0.0343796711509716, 'fraction_numerical': 0.001195814648729447, 'mean_word_length': 1.7561779242174629, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 8, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '864674', 'n_tokens_mistral': 902, 'n_tokens_neox': 839, 'n_words': 461}