continue pretraining mlm
#3
by
jiahaunluo
- opened
Thanks for the awesome work.
We would like to continue pretrain mlm model using run_mlm.py. But I encounter this ERROR:
This is the args:
I will update the modeling.py by https://huggingface.co/Alibaba-NLP/new-impl/discussions/5, this works for me.
izhx
changed discussion status to
closed