<commit_before># BIM - Benchmark Interpretability Method

This repository contains dataset, models, and metrics for benchmarking
interpretability methods (BIM) described in paper:

*   Title: "BIM: Towards Quantitative Evaluation of Interpretability Methods
    with Ground Truth"
*   Authors: Sherry (Mengjiao) Yang, <NAME>

Upon using this library, please cite:

```
@Article{BIM2019,
  title = {{BIM: Towards Quantitative Evaluation of Interpretability Methods with Ground Truth}},
  author = {<NAME> and <NAME>},<commit_msg>update citation<commit_after># BIM - Benchmark Interpretability Method

This repository contains dataset, models, and metrics for benchmarking
interpretability methods (BIM) described in paper [BIM: Towards Quantitative Evaluation of Interpretability Methods
with Ground Truth](https://arxiv.org/abs/1907.09701). Upon using this library, please cite:

```
@Article{BIM2019,
  title = {{BIM: Towards Quantitative Evaluation of Interpretability Methods with Ground Truth}},
  author = {<NAME> and <NAME>},
  journal   = {CoRR},
  volume    = {abs/1907.09701},
{'fraction_non_alphanumeric': 0.09216589861751152, 'fraction_numerical': 0.023963133640552997, 'mean_word_length': 5.464285714285714, 'pattern_counts': {'":': 0, '<': 8, '<?xml version=': 0, '>': 8, 'https://': 1, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1706765', 'n_tokens_mistral': 337, 'n_tokens_neox': 288, 'n_words': 114}