continue pretraining mlm

#3
by jiahaunluo - opened

Thanks for the awesome work.
We would like to continue pretrain mlm model using run_mlm.py. But I encounter this ERROR:

企业微信截图_17164360682596.png
This is the args:

企业微信截图_17164362535899.png

Alibaba-NLP org

I will update the modeling.py by https://huggingface.co/Alibaba-NLP/new-impl/discussions/5, this works for me.

izhx changed discussion status to closed

Sign up or log in to comment