<jupyter_start><jupyter_text>Setting up the environment<jupyter_code>!pip install -U allennlp==0.9.0
!git clone "https://github.com/ys7yoo/allennlp_imdb.git"<jupyter_output>Collecting allennlp==0.9.0
[?25l  Downloading https://files.pythonhosted.org/packages/bb/bb/041115d8bad1447080e5d1e30097c95e4b66e36074277afce8620a61cee3/allennlp-0.9.0-py3-none-any.whl (7.6MB)
[K     |████████████████████████████████| 7.6MB 21.8MB/s 
[?25hCollecting ftfy
[?25l  Downloading https://files.pythonhosted.org/packages/ff/e2/3b51c53dffb1e52d9210ebc01f1fb9f2f6eba9b3201fa971fd3946643c71/ftfy-5.8.tar.gz (64kB)
[K     |████████████████████████████████| 71kB 12.0MB/s 
[?25hCollecting responses>=0.7
  Downloading https://files.pythonhosted.org/packages/d5/71/4f04aed03ca35f2d02e1732ca6e996b2d7b40232fb7f1b58ff35f9a89b7b/responses-0.12.1-py2.py3-none-any.whl
Requirement already satisfied, skipping upgrade: h5py in /usr/local/lib/python3.6/dist-packages (from allennlp==0.9.0) (2.10.0)
Requirement already satisfied, skipping upgrade: torch>=1.2.0 in /usr/local/lib/python3.6/dist-packages (from allennlp==0.9.0) (1.7.0+cu101)
Collecting word2number>=1.1
  Downloading https://files.p[...]<jupyter_text>Running<jupyter_code>!cd allennlp_imdb; allennlp train --include-package allennlp_imdb training_config/base_cpu.jsonnet -s storage -f --cache-directory cache -o  '{"trainer": {"cuda_device": 0}}'<jupyter_output>/usr/local/lib/python3.6/dist-packages/requests/__init__.py:91: RequestsDependencyWarning: urllib3 (1.26.2) or chardet (3.0.4) doesn't match a supported version!
  RequestsDependencyWarning)
2020-11-20 13:40:50,915 - INFO - pytorch_pretrained_bert.modeling - Better speed can be achieved with apex installed from https://www.github.com/nvidia/apex .
2020-11-20 13:40:51,317 - INFO - pytorch_transformers.modeling_bert - Better speed can be achieved with apex installed from https://www.github.com/nvidia/apex .
2020-11-20 13:40:51,320 - INFO - pytorch_transformers.modeling_xlnet - Better speed can be achieved with apex installed from https://www.github.com/nvidia/apex .
2020-11-20 13:40:51,686 - INFO - allennlp.common.registrable - instantiating registered subclass relu of <class 'allennlp.nn.activations.Activation'>
2020-11-20 13:40:51,687 - INFO - allennlp.common.registrable - instantiating registered subclass relu of <class 'allennlp.nn.activations.Activation'>
2020-11-20 13:40:51,688 - I[...]<jupyter_text>TensorBoard Visualization<jupyter_code>%load_ext tensorboard
#%load_ext tensorboard.notebook
%tensorboard --logdir allennlp_imdb/storage/log
!pip uninstall -q tensorboard tb-nightly
!pip install -q tensorboard  # or tensorboard, but not both
y<jupyter_output><empty_output>
{'fraction_non_alphanumeric': 0.14990723562152133, 'fraction_numerical': 0.11131725417439703, 'mean_word_length': 5.607843137254902, 'pattern_counts': {'":': 2, '<': 13, '<?xml version=': 0, '>': 16, 'https://': 8, 'lorem ipsum': 0, 'www.': 3, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 4, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'chain_length': '3', 'dir': 'jupyter-structured-clean-dedup', 'id': '41611', 'license': 'MIT', 'n_tokens_mistral': 1253, 'n_tokens_neox': 1060, 'n_words': 173, 'path': 'AllenNLP_Gentle_Guide.ipynb', 'repo_name': 'ys7yoo/allennlp_imdb', 'size': '2695'}