<jupyter_start><jupyter_text>Simple fine-tuning<jupyter_code>!mkdir /gdrive/My\ Drive/bert/data/model/lm_finetuning/

# !rm -rf /gdrive/My\ Drive/bert/data/model/lm_finetuning/*
!ls
%cd /gdrive/My\ Drive/bert/data/model/lm_finetuning
!ls
### Simple fine-tuning
!python3 /gdrive/My\ Drive/bert/bert-cn/bert_server/simple_lm_finetuning.py --train_corpus /gdrive/My\ Drive/bert/data/corpus/my_corpus_cn.txt --bert_model bert-base-chinese --do_lower_case --output_dir /gdrive/My\ Drive/bert/data/model/lm_finetuning/ --do_train<jupyter_output>shell-init: error retrieving current directory: getcwd: cannot access parent directories: No such file or directory
sh: 0: getcwd() failed: No such file or directory
Intel MKL FATAL ERROR: Cannot load /usr/local/lib/python3.6/dist-packages/torch/lib/libcaffe2.so.
{'fraction_non_alphanumeric': 0.13092269326683292, 'fraction_numerical': 0.006234413965087282, 'mean_word_length': 4.861313868613139, 'pattern_counts': {'":': 0, '<': 4, '<?xml version=': 0, '>': 4, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'chain_length': '1', 'dir': 'jupyter-structured-clean-dedup', 'id': '259538', 'license': 'MIT', 'n_tokens_mistral': 309, 'n_tokens_neox': 301, 'n_words': 60, 'path': 'bert_server/simple_lm_finetuning.ipynb', 'repo_name': 'napoler/bert-cn', 'size': '802'}