tripathysagar
/

odia-gpt2-small

tripathysagar commited on Sep 28

Commit

eed12ba

•

1 Parent(s): 480e502

Upload tokenizer

Files changed (2) hide show

tokenizer.json CHANGED Viewed

The diff for this file is too large to render. See raw diff

tokenizer_config.json CHANGED Viewed

@@ -56,7 +56,7 @@
       "single_word": false,
       "special": true
     },
-    "36605": {
       "content": "[PAD]",
       "lstrip": false,
       "normalized": false,

       "single_word": false,
       "special": true
     },
+    "14610": {
       "content": "[PAD]",
       "lstrip": false,
       "normalized": false,