<commit_before>- [x] Read arff file (rarff)
- [x] Choose partition and decision attributes
- [x] Fix rico_patch.rb requiring
- [x] Specify min and max for partition sizes
- [x] Calculate partitions (hash of arrays?)
- [x] Specify whether or not to prune unecessary conditions
- [x] Command line options? (getopt?)
- [ ] Determine if partitions are equivalent (O(awful))
- [ ] Determine if a partition is minimal (O(worse)) (possibly avoidable)
- [x] Induce rules from partitions ("easy")
- [x] Remove unecessary conditions from rules
- [ ] Prompt for unspecified parameters
- [ ] Prompt for unspecified filename
- [ ] Provide minimum coverage restrictions on rule reporting
- [ ] Print values of input parameters
- [ ] Print distribution of values for decision attributes
- [ ] Calculate all coverings, not just one
- [ ] Print rules in a compact fashion
- [ ] Print coverage of each rule
- [ ] Consolidate rules after removing redundant conditions
- [ ] Test with large matrix and additional datasets
- [ ] DOCUMENT
- [ ] Go have a beer
- ~~[ ] Support for partitions on numeric data? (everything looks integer so we can treat it as discrete)~~<commit_msg>more stuff<commit_after>- [x] Read arff file (rarff)
- [x] Choose partition and decision attributes
- [x] Fix rico_patch.rb requiring
- [x] Specify min and max for partition sizes
- [x] Calculate partitions (hash of arrays?)
- [x] Specify whether or not to prune unecessary conditions
- [x] Command line options? (getopt?)
- [ ] Determine if partitions are equivalent (O(awful))
- [ ] Determine if a partition is minimal (O(worse)) (possibly avoidable)
- [x] Induce rules from partitions ("easy")
- [x] Remove unecessary conditions from rules
- [ ] Prompt for unspecified parameters
- [ ] Prompt for unspecified filename
- [ ] Provide minimum coverage restrictions on rule reporting
- [ ] Print values of input parameters
- [ ] Print distribution of values for decision attributes
- [ ] Calculate all coverings, not just one
- [ ] Print rules in a compact fashion
- [ ] Print coverage of each rule
- [ ] Consolidate rules after removing redundant conditions
- [ ] Test with large matrix and additional datasets
- [ ] Sort rule conditions by order of appearance?
- [ ] DOCUMENT
- [ ] Go have a beer
- ~~[ ] Support for partitions on numeric data? (everything looks integer so we can treat it as discrete)~~
{'fraction_non_alphanumeric': 0.09229466553767993, 'fraction_numerical': 0.0, 'mean_word_length': 4.081720430107527, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '838022', 'n_tokens_mistral': 656, 'n_tokens_neox': 619, 'n_words': 305}