gpt2-small-spanish / special_tokens_map.json

First version of the gpt2-small-spanish model and tokenizer. Primera version del modelo y tokenizer gpt2-small-spanish.

9e8d339 almost 4 years ago

387 Bytes

{"bos_token": {"content": "<|endoftext|>", "single_word": false, "lstrip": false, "rstrip": false, "normalized": true}, "eos_token": {"content": "<|endoftext|>", "single_word": false, "lstrip": false, "rstrip": false, "normalized": true}, "unk_token": {"content": "<|endoftext|>", "single_word": false, "lstrip": false, "rstrip": false, "normalized": true}, "pad_token": "<|endoftext|>"}