Hugging Face's logo

sreejith8100
/
layoutlm-funsd

Token Classification
Transformers
PyTorch
layoutlm
Generated from Trainer
Inference Endpoints
Model card Files Community
sreejith8100 commited on
Commit
1ac99ba
•
1 Parent(s): 8914641

End of training

Browse files
Files changed (2) hide show
  1. README.md +28 -28
  2. pytorch_model.bin +1 -1
README.md CHANGED
@@ -2,6 +2,8 @@
2
  base_model: microsoft/layoutlm-base-uncased
3
  tags:
4
  - generated_from_trainer
 
 
5
  model-index:
6
  - name: layoutlm-funsd
7
  results: []
@@ -12,18 +14,16 @@ should probably proofread and complete it, then remove this comment. -->
12
 
13
  # layoutlm-funsd
14
 
15
- This model is a fine-tuned version of [microsoft/layoutlm-base-uncased](https://huggingface.co/microsoft/layoutlm-base-uncased) on the None dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 0.0043
18
- - Ame: {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19}
19
- - Andom number: {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19}
20
- - Ather Name: {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19}
21
- - Lace Of Birth: {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 5}
22
- - Other Name: {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19}
23
- - Overall Precision: 1.0
24
- - Overall Recall: 1.0
25
- - Overall F1: 1.0
26
- - Overall Accuracy: 1.0
27
 
28
  ## Model description
29
 
@@ -52,23 +52,23 @@ The following hyperparameters were used during training:
52
 
53
  ### Training results
54
 
55
- | Training Loss | Epoch | Step | Validation Loss | Ame | Andom number | Ather Name | Lace Of Birth | Other Name | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
56
- |:-------------:|:-----:|:----:|:---------------:|:-------------------------------------------------------------------------------------------------------:|:----------------------------------------------------------:|:------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------:|:-------------------------------------------------------------------------------------------------------:|:-----------------:|:--------------:|:----------:|:----------------:|
57
- | 1.9017 | 1.0 | 6 | 1.1501 | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 19} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 19} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 19} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 5} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 19} | 0.0 | 0.0 | 0.0 | 0.7967 |
58
- | 0.8813 | 2.0 | 12 | 0.5397 | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 19} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 19} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 19} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 5} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 19} | 0.0 | 0.0 | 0.0 | 0.7967 |
59
- | 0.4889 | 3.0 | 18 | 0.3035 | {'precision': 0.5862068965517241, 'recall': 0.8947368421052632, 'f1': 0.7083333333333333, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 0.75, 'recall': 0.15789473684210525, 'f1': 0.2608695652173913, 'number': 19} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 5} | {'precision': 0.56, 'recall': 0.7368421052631579, 'f1': 0.6363636363636364, 'number': 19} | 0.6883 | 0.6543 | 0.6709 | 0.9431 |
60
- | 0.2784 | 4.0 | 24 | 0.1590 | {'precision': 0.95, 'recall': 1.0, 'f1': 0.9743589743589743, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 0.8260869565217391, 'recall': 1.0, 'f1': 0.9047619047619047, 'number': 19} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 5} | {'precision': 0.9333333333333333, 'recall': 0.7368421052631579, 'f1': 0.8235294117647058, 'number': 19} | 0.9221 | 0.8765 | 0.8987 | 0.9797 |
61
- | 0.1669 | 5.0 | 30 | 0.0903 | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 0.9444444444444444, 'recall': 0.8947368421052632, 'f1': 0.918918918918919, 'number': 19} | {'precision': 1.0, 'recall': 0.4, 'f1': 0.5714285714285715, 'number': 5} | {'precision': 0.8260869565217391, 'recall': 1.0, 'f1': 0.9047619047619047, 'number': 19} | 0.9383 | 0.9383 | 0.9383 | 0.9898 |
62
- | 0.1034 | 6.0 | 36 | 0.0486 | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 0.8, 'f1': 0.888888888888889, 'number': 5} | {'precision': 0.95, 'recall': 1.0, 'f1': 0.9743589743589743, 'number': 19} | 0.9877 | 0.9877 | 0.9877 | 0.9980 |
63
- | 0.0637 | 7.0 | 42 | 0.0232 | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 5} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | 1.0 | 1.0 | 1.0 | 1.0 |
64
- | 0.0403 | 8.0 | 48 | 0.0125 | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 5} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | 1.0 | 1.0 | 1.0 | 1.0 |
65
- | 0.0259 | 9.0 | 54 | 0.0087 | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 5} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | 1.0 | 1.0 | 1.0 | 1.0 |
66
- | 0.02 | 10.0 | 60 | 0.0068 | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 5} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | 1.0 | 1.0 | 1.0 | 1.0 |
67
- | 0.0166 | 11.0 | 66 | 0.0058 | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 5} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | 1.0 | 1.0 | 1.0 | 1.0 |
68
- | 0.0148 | 12.0 | 72 | 0.0053 | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 5} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | 1.0 | 1.0 | 1.0 | 1.0 |
69
- | 0.0126 | 13.0 | 78 | 0.0047 | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 5} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | 1.0 | 1.0 | 1.0 | 1.0 |
70
- | 0.0122 | 14.0 | 84 | 0.0044 | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 5} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | 1.0 | 1.0 | 1.0 | 1.0 |
71
- | 0.014 | 15.0 | 90 | 0.0043 | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 5} | {'precision': 1.0, 'recall': 1.0, 'f1': 1.0, 'number': 19} | 1.0 | 1.0 | 1.0 | 1.0 |
72
 
73
 
74
  ### Framework versions
 
2
  base_model: microsoft/layoutlm-base-uncased
3
  tags:
4
  - generated_from_trainer
5
+ datasets:
6
+ - funsd
7
  model-index:
8
  - name: layoutlm-funsd
9
  results: []
 
14
 
15
  # layoutlm-funsd
16
 
17
+ This model is a fine-tuned version of [microsoft/layoutlm-base-uncased](https://huggingface.co/microsoft/layoutlm-base-uncased) on the funsd dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.7204
20
+ - Answer: {'precision': 0.7103218645948945, 'recall': 0.7911001236093943, 'f1': 0.7485380116959064, 'number': 809}
21
+ - Header: {'precision': 0.3697478991596639, 'recall': 0.3697478991596639, 'f1': 0.3697478991596639, 'number': 119}
22
+ - Question: {'precision': 0.7799126637554585, 'recall': 0.8384976525821596, 'f1': 0.8081447963800905, 'number': 1065}
23
+ - Overall Precision: 0.7284
24
+ - Overall Recall: 0.7913
25
+ - Overall F1: 0.7585
26
+ - Overall Accuracy: 0.7930
 
 
27
 
28
  ## Model description
29
 
 
52
 
53
  ### Training results
54
 
55
+ | Training Loss | Epoch | Step | Validation Loss | Answer | Header | Question | Overall Precision | Overall Recall | Overall F1 | Overall Accuracy |
56
+ |:-------------:|:-----:|:----:|:---------------:|:------------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------:|:-----------------:|:--------------:|:----------:|:----------------:|
57
+ | 1.8258 | 1.0 | 10 | 1.6104 | {'precision': 0.03933136676499508, 'recall': 0.049443757725587144, 'f1': 0.04381161007667032, 'number': 809} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 119} | {'precision': 0.2102076124567474, 'recall': 0.22816901408450704, 'f1': 0.21882035119315627, 'number': 1065} | 0.1302 | 0.1420 | 0.1359 | 0.3742 |
58
+ | 1.4584 | 2.0 | 20 | 1.2730 | {'precision': 0.1923509561304837, 'recall': 0.21137206427688504, 'f1': 0.20141342756183747, 'number': 809} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 119} | {'precision': 0.4099290780141844, 'recall': 0.5427230046948357, 'f1': 0.467070707070707, 'number': 1065} | 0.3258 | 0.3758 | 0.3490 | 0.5734 |
59
+ | 1.1076 | 3.0 | 30 | 0.9718 | {'precision': 0.501532175689479, 'recall': 0.6069221260815822, 'f1': 0.5492170022371365, 'number': 809} | {'precision': 0.0, 'recall': 0.0, 'f1': 0.0, 'number': 119} | {'precision': 0.5749211356466877, 'recall': 0.6845070422535211, 'f1': 0.6249464209172738, 'number': 1065} | 0.5358 | 0.6121 | 0.5714 | 0.6890 |
60
+ | 0.8541 | 4.0 | 40 | 0.8287 | {'precision': 0.5573921028466483, 'recall': 0.7503090234857849, 'f1': 0.6396206533192834, 'number': 809} | {'precision': 0.14893617021276595, 'recall': 0.058823529411764705, 'f1': 0.08433734939759036, 'number': 119} | {'precision': 0.6451342281879194, 'recall': 0.7220657276995305, 'f1': 0.6814355338945502, 'number': 1065} | 0.5941 | 0.6939 | 0.6401 | 0.7420 |
61
+ | 0.7105 | 5.0 | 50 | 0.7483 | {'precision': 0.6358695652173914, 'recall': 0.723114956736712, 'f1': 0.6766917293233082, 'number': 809} | {'precision': 0.2465753424657534, 'recall': 0.15126050420168066, 'f1': 0.18749999999999997, 'number': 119} | {'precision': 0.6898305084745763, 'recall': 0.7643192488262911, 'f1': 0.7251670378619154, 'number': 1065} | 0.6521 | 0.7110 | 0.6803 | 0.7618 |
62
+ | 0.6079 | 6.0 | 60 | 0.7023 | {'precision': 0.6306209850107066, 'recall': 0.7280593325092707, 'f1': 0.6758462421113023, 'number': 809} | {'precision': 0.2875, 'recall': 0.19327731092436976, 'f1': 0.23115577889447236, 'number': 119} | {'precision': 0.6796267496111975, 'recall': 0.8206572769953052, 'f1': 0.7435133985538068, 'number': 1065} | 0.6461 | 0.7456 | 0.6923 | 0.7776 |
63
+ | 0.5267 | 7.0 | 70 | 0.6779 | {'precision': 0.674892703862661, 'recall': 0.7775030902348579, 'f1': 0.7225732337736933, 'number': 809} | {'precision': 0.3, 'recall': 0.226890756302521, 'f1': 0.25837320574162675, 'number': 119} | {'precision': 0.717391304347826, 'recall': 0.8056338028169014, 'f1': 0.7589562140645733, 'number': 1065} | 0.6826 | 0.7597 | 0.7191 | 0.7853 |
64
+ | 0.4735 | 8.0 | 80 | 0.6688 | {'precision': 0.6955093099671413, 'recall': 0.7849196538936959, 'f1': 0.7375145180023228, 'number': 809} | {'precision': 0.32608695652173914, 'recall': 0.25210084033613445, 'f1': 0.2843601895734597, 'number': 119} | {'precision': 0.7424892703862661, 'recall': 0.812206572769953, 'f1': 0.7757847533632287, 'number': 1065} | 0.7051 | 0.7677 | 0.7350 | 0.7950 |
65
+ | 0.4196 | 9.0 | 90 | 0.6791 | {'precision': 0.6843243243243243, 'recall': 0.7824474660074165, 'f1': 0.7301038062283737, 'number': 809} | {'precision': 0.3181818181818182, 'recall': 0.29411764705882354, 'f1': 0.3056768558951965, 'number': 119} | {'precision': 0.7561807331628303, 'recall': 0.8328638497652582, 'f1': 0.7926720285969615, 'number': 1065} | 0.7043 | 0.7802 | 0.7403 | 0.7937 |
66
+ | 0.3756 | 10.0 | 100 | 0.6968 | {'precision': 0.7089887640449438, 'recall': 0.7799752781211372, 'f1': 0.7427898763978811, 'number': 809} | {'precision': 0.328, 'recall': 0.3445378151260504, 'f1': 0.33606557377049184, 'number': 119} | {'precision': 0.7790393013100436, 'recall': 0.8375586854460094, 'f1': 0.807239819004525, 'number': 1065} | 0.7241 | 0.7847 | 0.7532 | 0.7947 |
67
+ | 0.3402 | 11.0 | 110 | 0.6959 | {'precision': 0.7024070021881839, 'recall': 0.7935723114956736, 'f1': 0.7452118398142775, 'number': 809} | {'precision': 0.3416666666666667, 'recall': 0.3445378151260504, 'f1': 0.34309623430962344, 'number': 119} | {'precision': 0.7791411042944786, 'recall': 0.8347417840375587, 'f1': 0.8059836808703537, 'number': 1065} | 0.7228 | 0.7888 | 0.7543 | 0.7958 |
68
+ | 0.3225 | 12.0 | 120 | 0.6945 | {'precision': 0.7106430155210643, 'recall': 0.792336217552534, 'f1': 0.7492694330800702, 'number': 809} | {'precision': 0.3644067796610169, 'recall': 0.36134453781512604, 'f1': 0.3628691983122363, 'number': 119} | {'precision': 0.7667238421955404, 'recall': 0.8394366197183099, 'f1': 0.8014343343792021, 'number': 1065} | 0.7219 | 0.7918 | 0.7552 | 0.7961 |
69
+ | 0.3031 | 13.0 | 130 | 0.7204 | {'precision': 0.71, 'recall': 0.7898640296662547, 'f1': 0.7478057343475717, 'number': 809} | {'precision': 0.35, 'recall': 0.35294117647058826, 'f1': 0.35146443514644354, 'number': 119} | {'precision': 0.7895204262877442, 'recall': 0.8347417840375587, 'f1': 0.8115015974440895, 'number': 1065} | 0.7316 | 0.7878 | 0.7586 | 0.7916 |
70
+ | 0.289 | 14.0 | 140 | 0.7196 | {'precision': 0.7095709570957096, 'recall': 0.7972805933250927, 'f1': 0.750873108265425, 'number': 809} | {'precision': 0.3826086956521739, 'recall': 0.3697478991596639, 'f1': 0.37606837606837606, 'number': 119} | {'precision': 0.7816593886462883, 'recall': 0.8403755868544601, 'f1': 0.8099547511312217, 'number': 1065} | 0.7303 | 0.7948 | 0.7612 | 0.7949 |
71
+ | 0.2801 | 15.0 | 150 | 0.7204 | {'precision': 0.7103218645948945, 'recall': 0.7911001236093943, 'f1': 0.7485380116959064, 'number': 809} | {'precision': 0.3697478991596639, 'recall': 0.3697478991596639, 'f1': 0.3697478991596639, 'number': 119} | {'precision': 0.7799126637554585, 'recall': 0.8384976525821596, 'f1': 0.8081447963800905, 'number': 1065} | 0.7284 | 0.7913 | 0.7585 | 0.7930 |
72
 
73
 
74
  ### Framework versions
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1fe87bf66bbf002163441babaac3a7e3d8b1ae680caa814c0e71610fb20525b1
3
  size 450603969
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ef68c81af54b51c68afbfae21e6356508e9ef0e3b5ffd97882bb2e9a11d3d44
3
  size 450603969