<commit_before># Continuting design principles of ack 2.0

ack will still:

* only search files of types it recognizes

* ignore version control directories, core dumps and other large files

* allow user-specified filetype detection

* be distributed as a standalone

* be distributed through CPAN

* never be a file editor

* be purely Perl 5, and use Perl 5 regular expressions

* support a local ~/.ackrc

* sniff shebang lines to detect language

* try to be as switch-compatible with GNU grep as possible

* be taint-safe<commit_msg>pulling in stuff from old wiki<commit_after># Continuting design principles of ack 2.0

ack will still:

* only search files of types it recognizes

* ignore version control directories, core dumps and other large files

* allow user-specified filetype detection

* be distributed through CPAN

* be distributed as a standalone
    * No modules other than File::Next can be required except for what comes with core Perl.
    * Plugins can require whatever they want, like Archive::Tar

* never be a file editor

* be purely Perl 5, and use Perl 5 regular expressions

* support a local ~/.ackrc

* sniff shebang lines to detect language

* try to be as switch-compatible with GNU grep as possible

* be taint-safe
{'fraction_non_alphanumeric': 0.0463258785942492, 'fraction_numerical': 0.006389776357827476, 'mean_word_length': 4.012, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '3451698', 'n_tokens_mistral': 353, 'n_tokens_neox': 327, 'n_words': 181}