<jupyter_start><jupyter_text>Single model performance - ProBERT<jupyter_code>!python run.py --train --model=probert --language_model=bert-large-uncased --verbose=1 --exp_dir=results/single_model<jupyter_output>/usr/lib/python3.6/importlib/_bootstrap.py:219: RuntimeWarning: spacy.vocab.Vocab size changed, may indicate binary incompatibility. Expected 96 from C header, got 104 from PyObject
  return f(*args, **kwds)
06/04/2019 17:50:36 - INFO - neuralcoref -   Loading model from /home/sandeep_attree/.neuralcoref_cache/neuralcoref
WARNING: Logging before flag parsing goes to stderr.
W0604 17:50:36.330217 140448954050304 __init__.py:56] Some hub symbols are not available because TensorFlow version is less than 1.14

WARNING: The TensorFlow contrib module will not be included in TensorFlow 2.0.
For more information, please see:
  * https://github.com/tensorflow/community/blob/master/rfcs/20180907-contrib-sunset.md
  * https://github.com/tensorflow/addons
If you depend on functionality not listed there, please file an issue.

                  id            text pronoun  ...  b_offset b_coref             url
0      development-1  Zoe Telford...     her  ...       207   False  http://en.w...
1     [...]<jupyter_text>Single model performance - GREP<jupyter_code>!python run.py --train --model=grep --language_model=bert-large-uncased --verbose=1 --exp_dir=results/single_model<jupyter_output>/usr/lib/python3.6/importlib/_bootstrap.py:219: RuntimeWarning: spacy.vocab.Vocab size changed, may indicate binary incompatibility. Expected 96 from C header, got 104 from PyObject
  return f(*args, **kwds)
06/04/2019 22:18:12 - INFO - neuralcoref -   Loading model from /home/sandeep_attree/.neuralcoref_cache/neuralcoref
WARNING: Logging before flag parsing goes to stderr.
W0604 22:18:12.183774 140124348446464 __init__.py:56] Some hub symbols are not available because TensorFlow version is less than 1.14

WARNING: The TensorFlow contrib module will not be included in TensorFlow 2.0.
For more information, please see:
  * https://github.com/tensorflow/community/blob/master/rfcs/20180907-contrib-sunset.md
  * https://github.com/tensorflow/addons
If you depend on functionality not listed there, please file an issue.

                  id            text pronoun  ...  b_offset b_coref             url
0      development-1  Zoe Telford...     her  ...       207   False  http://en.w...
1     [...]<jupyter_text>Kaggle submission model<jupyter_code>!python run.py --train --kaggle --model=grep --language_model=bert-large-uncased --coref_models=url,allen,hug,lee --preprocess_train --preprocess_eval --verbose=1 --exp_dir=results/kaggle --test_path=data/test_stage_2.tsv --sub_sample_path=sample_submission_stage_2.csv<jupyter_output>/usr/lib/python3.6/importlib/_bootstrap.py:219: RuntimeWarning: spacy.vocab.Vocab size changed, may indicate binary incompatibility. Expected 96 from C header, got 104 from PyObject
  return f(*args, **kwds)
06/04/2019 23:17:07 - INFO - neuralcoref -   Loading model from /home/sandeep_attree/.neuralcoref_cache/neuralcoref
WARNING: Logging before flag parsing goes to stderr.
W0604 23:17:07.584630 140623027300096 __init__.py:56] Some hub symbols are not available because TensorFlow version is less than 1.14

WARNING: The TensorFlow contrib module will not be included in TensorFlow 2.0.
For more information, please see:
  * https://github.com/tensorflow/community/blob/master/rfcs/20180907-contrib-sunset.md
  * https://github.com/tensorflow/addons
If you depend on functionality not listed there, please file an issue.

/usr/local/lib/python3.6/dist-packages/torch/nn/modules/rnn.py:46: UserWarning: dropout option adds dropout after all but last recurrent layer, so non-zero dropout expects nu[...]
{'fraction_non_alphanumeric': 0.10026666666666667, 'fraction_numerical': 0.0616, 'mean_word_length': 3.9096858638743455, 'pattern_counts': {'":': 0, '<': 10, '<?xml version=': 0, '>': 10, 'https://': 6, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'chain_length': '3', 'dir': 'jupyter-structured-clean-dedup', 'id': '178118', 'license': 'MIT', 'n_tokens_mistral': 1331, 'n_tokens_neox': 1180, 'n_words': 334, 'path': 'usage.ipynb', 'repo_name': 'MutualMarkets/gap', 'size': '3750'}