| language: en | |
| license: mit | |
| library_name: pytorch | |
| # Plainly Optimized Network | |
| Dataset: BIGBENCH | |
| Trainer Hyperparameters: | |
| - `lr` = 5e-05 | |
| - `per_device_batch_size` = 1 | |
| - `gradient_accumulation_steps` = 4 | |
| - `weight_decay` = 1e-09 | |
| - `seed` = 42 | |
| |eval_loss|eval_mse|epoch| | |
| |--|--|--| | |
| |58.741|0.055|1.0| | |
| |60.624|0.058|2.0| | |
| |60.765|0.057|3.0| | |
| |55.858|0.051|4.0| | |
| |57.271|0.053|5.0| | |
| |56.004|0.051|6.0| | |
| |60.246|0.056|7.0| | |
| |55.218|0.049|8.0| | |
| |55.261|0.049|9.0| | |
| |54.730|0.049|10.0| | |
| |58.137|0.052|11.0| | |
| |53.927|0.048|12.0| | |
| |56.143|0.051|13.0| | |
| |54.604|0.049|14.0| | |
| |53.596|0.048|15.0| | |
| |54.241|0.049|16.0| | |
| |55.500|0.050|17.0| | |
| |53.256|0.047|18.0| | |
| |53.139|0.047|19.0| | |