tokenizer无法在文本中切分special token

#1
by JaheimLee - opened

如题,怎么可以设置一下啊,你们源码中也是手动进行的id赋值,但这并不是很方便。

JaheimLee changed discussion status to closed

Sign up or log in to comment