ydshieh
/

test-dynamic-processor

Model card Files Files and versions Community

test-dynamic-processor / custom_tokenization.py

ydshieh's picture

ydshieh HF staff

commit files to HF hub

990cd1d 11 months ago

history blame contribute delete

88 Bytes

	from transformers import BertTokenizer


	class CustomTokenizer(BertTokenizer):
	pass