DUNHILL commited on
Commit
ce45771
1 Parent(s): 36386a8

Model save

Browse files
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [dandelin/vilt-b32-mlm](https://huggingface.co/dandelin/vilt-b32-mlm) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 2.0458
20
 
21
  ## Model description
22
 
@@ -36,7 +36,7 @@ More information needed
36
 
37
  The following hyperparameters were used during training:
38
  - learning_rate: 5e-05
39
- - train_batch_size: 4
40
  - eval_batch_size: 16
41
  - seed: 42
42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
@@ -47,9 +47,9 @@ The following hyperparameters were used during training:
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
- | 1.4121 | 1.0 | 150 | 1.3413 |
51
- | 1.2149 | 2.0 | 300 | 1.6680 |
52
- | 0.893 | 3.0 | 450 | 2.0458 |
53
 
54
 
55
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [dandelin/vilt-b32-mlm](https://huggingface.co/dandelin/vilt-b32-mlm) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.4644
20
 
21
  ## Model description
22
 
 
36
 
37
  The following hyperparameters were used during training:
38
  - learning_rate: 5e-05
39
+ - train_batch_size: 8
40
  - eval_batch_size: 16
41
  - seed: 42
42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
+ | 0.4691 | 1.0 | 250 | 0.3940 |
51
+ | 0.3872 | 2.0 | 500 | 0.4159 |
52
+ | 0.3803 | 3.0 | 750 | 0.4644 |
53
 
54
 
55
  ### Framework versions
runs/Oct18_05-18-48_ea4e09bba85e/events.out.tfevents.1729228740.ea4e09bba85e.6386.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:752372019de72b03ed80da334a14b133e731b9091563664028a0385f6881d41e
3
- size 8777
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02600cecd56d56f79f4df931281c68292636cbbc0035e19086fc63feadd1868f
3
+ size 9402