<commit_before>.\" Call make README after modifying this file.
.TH FDUP 1 "August 2013" "<NAME>" "User Commands"

.SH NAME
fdup \- find duplicates

.SH SYNOPSIS
.B fdup
.RI [ MODE ]
.RI [ OPTION "...]"
.IR directory ...

.SH DESCRIPTION
.B fdup
traverses the supplied directories and finds file with equal contents.
.B fdup
outputs statistics to
.BR stderr (3)
while processing files.
.B fdup
will not follow symbolic links it encounters.

.SH OPTIONS

This utility has three modes of operation. These are selected by exactly one of
he options
.BR \-H ,
.B \-L
and
.BR \-S .
The default mode is
.BR \-L .<commit_msg>Reformulations to the manual text<commit_after>.\" Call make README after modifying this file.
.TH FDUP 1 "August 2013" "<NAME>" "User Commands"

.SH NAME
fdup \- find duplicates

.SH SYNOPSIS
.B fdup
.RI [ MODE ]
.RI [ OPTION "...]"
.IR directory ...

.SH DESCRIPTION
.B fdup
traverses the supplied directories and finds file with equal contents.
.B fdup
outputs statistics to
.BR stderr (3)
while processing files.
.B fdup
will not follow symbolic links it encounters.

.SH OPTIONS

This utility has three modes of operation. These are selected with the options
.BR \-H ,
.B \-L
and
.BR \-S .
If none of these options is given,
.B fdup
behaves as if
.B \-S
was selected. If more than one mode of operation is given, only the last mode
that was passed counts.
{'fraction_non_alphanumeric': 0.09447674418604651, 'fraction_numerical': 0.00872093023255814, 'mean_word_length': 3.147590361445783, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 5, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '837764', 'n_tokens_mistral': 483, 'n_tokens_neox': 433, 'n_words': 220}