<commit_before># TODO

## Version 3.0

- [ ] Update the README file: explain the main features, explain how it works (use tree pictures, ...),
      explain why the clone search is not "trivial" at all (md5 not filename, minimal
      list, likelyhood similitudes, ...), ...
- [ ] Clean, add docstrings, test, ...
- [ ] Add a setup.py file
- [ ] Create a Debian package
- [ ] Let it work on Windows platforms + add installation instructions for windows in the README file

## Version 3.1

- [ ] Add a graphical user interface (GTK+3)
    - [ ] Select directories
    - [ ] Progress bar (2 pass scan)
    - [ ] Result in a TreeView
    - [ ] Actions (remove a file, ...)
    - ...
- [ ] Update the README file: new instructions for the GUI, user guide, ...

- [ ] Read http://www.techsupportalert.com/best-free-duplicate-file-detector.htm<commit_msg>Update the TODO list.<commit_after># TODO

## Version 3.0

- [ ] Update the README file: explain the main features, explain how it works
      (use tree pictures, ...), explain why the duplicate file search is not
      "trivial" at all (md5 not filename, minimal list, likelyhood similitudes,
      ...), ...
- [ ] Clean, add docstrings, test, ...
- [ ] Add a setup.py file
- [ ] Create a Debian package
- [ ] Let it work on Windows platforms + add installation instructions for
      Windows in the README file

## Version 3.1

- [ ] Add a graphical user interface (GTK+3)
    - [ ] Select directories
    - [ ] Progress bar (2 pass scan)
    - [ ] Result in a TreeView
    - [ ] Actions (remove a file, ...)
    - ...
- [ ] Update the README file: new instructions for the GUI, user guide, ...

- [ ] Read http://www.techsupportalert.com/best-free-duplicate-file-detector.htm
{'fraction_non_alphanumeric': 0.12680949623624782, 'fraction_numerical': 0.008106543138390272, 'mean_word_length': 2.630252100840336, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '541429', 'n_tokens_mistral': 523, 'n_tokens_neox': 503, 'n_words': 201}