beomi
/

kykim-gpt3-kor-small_based_on_gpt2

kykim-gpt3-kor-small_based_on_gpt2 / tokenizer_config.json

Add Support for AutoTokenizer and Pipeline

f000713 about 3 years ago

119 Bytes

	{
	"do_lower_case": true,
	"strip_accents": false,
	"model_max_length": 2048,
	"tokenizer_class": "BertTokenizer"
	}