<commit_before># file-duplicates
> During the development of a node app I had to check for potential duplicates of files uploaded by users. 
I wrote this package to address this particular problem: given in input a file or buffer, it returns the absolute 
paths to duplicated files starting from the specified directory (otherwise the working directory will be used as
starting point). The comparison between files is done at byte level. It is possible to provide an array of patterns to
ignore specific files or folders. Both sync and async API are provided. 



## Information
| Package       | file-duplicates  |
| ------------- |--------------|                                   
| Node Version  | >= 4.8.4       |


## Table of Contents

<!-- toc -->

* [Information](#information)
* [Installation](#installation)
* [Usage](#usage)
* [API](#api)
  * [find(String or Buffer, [String], [Array], [function])](#find)
  * [findSync(String or Buffer, [String], [Array], [function])](#findSync)
* [Notes](#notes)
* [License](#license)

<!-- toc stop -->


## Installation
Install package as dependency:
```shell
npm install --save file-equal-content<commit_msg>README.md modified.<commit_after># file-duplicates
> During the development of a node app I had to check for potential duplicates of files uploaded by users. 
I wrote this package to address this particular problem: given in input a file or buffer, it returns the absolute 
paths to duplicated files starting from the specified directory (otherwise the working directory will be used as
starting point). The comparison between files is done at byte level. It is possible to provide an array of patterns to
ignore specific files or folders. Both sync and async API are provided. 



## Information
| Package       | file-duplicates  |
| ------------- |--------------|                                   
| Node Version  | >= 4.8.4       |


## Table of Contents

<!-- toc -->

* [Information](#information)
* [Installation](#installation)
* [Usage](#usage)
* [API](#api)
  * [find(String or Buffer, [String], [Array], [function])](#find)
  * [findSync(String or Buffer, [String], [Array], [function])](#findSync)
* [Notes](#notes)
* [License](#license)

<!-- toc stop -->


## Installation
Install package as dependency:
```shell
npm install --save file-duplicates
{'fraction_non_alphanumeric': 0.13313227057302887, 'fraction_numerical': 0.0025850926324859974, 'mean_word_length': 3.276243093922652, 'pattern_counts': {'":': 0, '<': 7, '<?xml version=': 0, '>': 11, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '694815', 'n_tokens_mistral': 639, 'n_tokens_neox': 588, 'n_words': 262}