File size: 651 Bytes
fc73e33
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
75cf489
153b831
3f02fe2
53231e0
6c1681c
16b0a91
d5af040
c0cb491
c236b02
066c7a4
e74c857
32bce8c
a211f41
f15aa6e
3166372
35a0199
584e9d3
2c56d09
5b2c8db
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
---
language: en
license: mit
library_name: pytorch
---
# Plainly Optimized Network
Dataset: BIGBENCH

Trainer Hyperparameters:
- `lr` = 5e-05
- `per_device_batch_size` = 8
- `gradient_accumulation_steps` = 2
- `weight_decay` = 0.0
- `seed` = 42

|eval_loss|eval_accuracy|epoch|
|--|--|--|
|10.410|0.571|1.0|
|10.191|0.571|2.0|
|9.468|0.643|3.0|
|10.414|0.571|4.0|
|10.468|0.571|5.0|
|10.335|0.571|6.0|
|10.296|0.571|7.0|
|9.998|0.571|8.0|
|10.080|0.571|9.0|
|10.186|0.571|10.0|
|9.862|0.571|11.0|
|10.713|0.500|12.0|
|9.873|0.571|13.0|
|9.905|0.571|14.0|
|9.860|0.571|15.0|
|9.997|0.571|16.0|
|9.823|0.571|17.0|
|9.840|0.571|18.0|
|9.817|0.571|19.0|