Yiheng Xu commited on
Commit
91acf0f
1 Parent(s): 4678df1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -6
README.md CHANGED
@@ -10,12 +10,14 @@ LayoutLM is a simple but effective pre-training method of text and layout for do
10
  [LayoutLM: Pre-training of Text and Layout for Document Image Understanding](https://arxiv.org/abs/1912.13318)
11
  Yiheng Xu, Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou, [KDD 2020](https://www.kdd.org/kdd2020/accepted-papers)
12
 
13
- ## Training data
14
-
15
- We pre-train LayoutLM on IIT-CDIP Test Collection 1.0\* dataset with two settings.
16
-
17
- * LayoutLM-Base, Uncased (11M documents, 2 epochs): 12-layer, 768-hidden, 12-heads, 113M parameters **(This Model)**
18
- * LayoutLM-Large, Uncased (11M documents, 2 epochs): 24-layer, 1024-hidden, 16-heads, 343M parameters
 
 
19
 
20
  ## Citation
21
 
 
10
  [LayoutLM: Pre-training of Text and Layout for Document Image Understanding](https://arxiv.org/abs/1912.13318)
11
  Yiheng Xu, Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou, [KDD 2020](https://www.kdd.org/kdd2020/accepted-papers)
12
 
13
+ ## Different Tokenizer
14
+ Note that LayoutLM-Cased requires a different tokenizer, based on RobertaTokenizer. You can
15
+ initialize it as follows:
16
+
17
+ ~~~
18
+ from transformers import AutoTokenizer
19
+ tokenizer = AutoTokenizer.from_pretrained('microsoft/layoutlm-base-cased')
20
+ ~~~
21
 
22
  ## Citation
23