<commit_before># fb15k-237-akbc

A set of Jupyter notebooks capturing an effort to apply Keras to the
problem of automatic knowledge based completion, using the universal
schema [[1]](http://www.riedelcastro.org//publications/papers/riedel13relation.pdf)
approach. We use the FB215-237 dataset [[2]](https://www.microsoft.com/en-us/download/details.aspx?id=52312)
developed by Toutanova and her collaborators [[3]](https://www.microsoft.com/en-us/research/wp-content/uploads/2016/02/main_cvsc2015.pdf),
[[4]](https://www.microsoft.com/en-us/research/wp-content/uploads/2016/02/emnlp2015kgtext.pdf) at Microsoft Research to
evaluate the implementation's performance.

The notebooks provide the following workflows:

* FB215-237 ETL: loads and processes triples from the dataset, augmenting them with data useful as inputs to the Keras model.
* FB215-237 Training: trains an instance of CFModel using the prepared data.
* FB215-237 Evaluation: evaluates the trained model using the protocol described in Toutanova and Chen [[3]].

## Requirements

* Python 2.7
* A copy of the FB215-237 dataset, downloaded from [[2]].

## Dependencies

* pandas 0.18.1
* keras 1.0.6<commit_msg>Fixed missing link in README.md<commit_after># fb15k-237-akbc

A set of Jupyter notebooks capturing an effort to apply Keras to the
problem of automatic knowledge based completion, using the universal
schema [[1]](http://www.riedelcastro.org//publications/papers/riedel13relation.pdf)
approach. We use the FB215-237 dataset [[2]](https://www.microsoft.com/en-us/download/details.aspx?id=52312)
developed by Toutanova and her collaborators [[3]](https://www.microsoft.com/en-us/research/wp-content/uploads/2016/02/main_cvsc2015.pdf),
[[4]](https://www.microsoft.com/en-us/research/wp-content/uploads/2016/02/emnlp2015kgtext.pdf) at Microsoft Research to
evaluate the implementation's performance.

The notebooks provide the following workflows:

* FB215-237 ETL: loads and processes triples from the dataset, augmenting them with data useful as inputs to the Keras model.
* FB215-237 Training: trains an instance of CFModel using the prepared data.
* FB215-237 Evaluation: evaluates the trained model using the protocol described in Toutanova and Chen [[3]].

## Requirements

* Python 2.7
* A copy of the FB215-237 dataset, downloaded from [[2]](https://www.microsoft.com/en-us/download/details.aspx?id=52312).

## Dependencies

* pandas 0.18.1
* keras 1.0.6
{'fraction_non_alphanumeric': 0.10969597370583402, 'fraction_numerical': 0.06532456861133935, 'mean_word_length': 4.9535452322738385, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 7, 'lorem ipsum': 0, 'www.': 9, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 5, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1388865', 'n_tokens_mistral': 890, 'n_tokens_neox': 734, 'n_words': 239}