LABEL_0 LABEL_1 LABEL_10 LABEL_100 LABEL_101 LABEL_102 LABEL_103 LABEL_104 LABEL_105 LABEL_106 LABEL_107 LABEL_108 LABEL_109 LABEL_11 LABEL_110 LABEL_111 LABEL_112 LABEL_113 LABEL_114 LABEL_115 LABEL_116 LABEL_117 LABEL_118 LABEL_119 LABEL_12 LABEL_120 LABEL_121 LABEL_122 LABEL_123 LABEL_124 LABEL_125 LABEL_126 LABEL_127 LABEL_128 LABEL_129 LABEL_13 LABEL_130 LABEL_131 LABEL_132 LABEL_133 LABEL_134 LABEL_135 LABEL_136 LABEL_137 LABEL_138 LABEL_139 LABEL_14 LABEL_140 LABEL_141 LABEL_142 LABEL_143 LABEL_144 LABEL_145 LABEL_146 LABEL_147 LABEL_148 LABEL_149 LABEL_15 LABEL_150 LABEL_151 LABEL_152 LABEL_153 LABEL_154 LABEL_155 LABEL_156 LABEL_157 LABEL_158 LABEL_159 LABEL_16 LABEL_160 LABEL_161 LABEL_162 LABEL_163 LABEL_164 LABEL_165 LABEL_166 LABEL_167 LABEL_168 LABEL_169 LABEL_17 LABEL_170 LABEL_171 LABEL_172 LABEL_173 LABEL_174 LABEL_175 LABEL_176 LABEL_177 LABEL_178 LABEL_179 LABEL_18 LABEL_180 LABEL_181 LABEL_182 LABEL_183 LABEL_184 LABEL_185 LABEL_186 LABEL_187 LABEL_188 LABEL_189 LABEL_19 LABEL_190 LABEL_191 LABEL_192 LABEL_193 LABEL_194 LABEL_195 LABEL_196 LABEL_197 LABEL_198 LABEL_199 LABEL_2 LABEL_20 LABEL_200 LABEL_201 LABEL_202 LABEL_203 LABEL_204 LABEL_205 LABEL_206 LABEL_207 LABEL_208 LABEL_209 LABEL_21 LABEL_210 LABEL_211 LABEL_212 LABEL_213 LABEL_214 LABEL_215 LABEL_216 LABEL_217 LABEL_218 LABEL_219 LABEL_22 LABEL_220 LABEL_221 LABEL_222 LABEL_223 LABEL_224 LABEL_225 LABEL_226 LABEL_227 LABEL_228 LABEL_229 LABEL_23 LABEL_230 LABEL_231 LABEL_232 LABEL_233 LABEL_234 LABEL_235 LABEL_236 LABEL_237 LABEL_238 LABEL_239 LABEL_24 LABEL_240 LABEL_241 LABEL_242 LABEL_243 LABEL_244 LABEL_245 LABEL_246 LABEL_247 LABEL_248 LABEL_249 LABEL_25 LABEL_250 LABEL_251 LABEL_252 LABEL_253 LABEL_254 LABEL_255 LABEL_256 LABEL_257 LABEL_258 LABEL_259 LABEL_26 LABEL_260 LABEL_261 LABEL_262 LABEL_263 LABEL_264 LABEL_265 LABEL_266 LABEL_267 LABEL_268 LABEL_269 LABEL_27 LABEL_270 LABEL_271 LABEL_272 LABEL_273 LABEL_274 LABEL_275 LABEL_276 LABEL_277 LABEL_278 LABEL_279 LABEL_28 LABEL_280 LABEL_281 LABEL_282 LABEL_283 LABEL_284 LABEL_285 LABEL_286 LABEL_287 LABEL_288 LABEL_289 LABEL_29 LABEL_290 LABEL_291 LABEL_292 LABEL_293 LABEL_294 LABEL_295 LABEL_296 LABEL_297 LABEL_298 LABEL_299 LABEL_3 LABEL_30 LABEL_300 LABEL_301 LABEL_302 LABEL_303 LABEL_304 LABEL_305 LABEL_306 LABEL_307 LABEL_308 LABEL_309 LABEL_31 LABEL_310 LABEL_311 LABEL_312 LABEL_313 LABEL_314 LABEL_315 LABEL_316 LABEL_317 LABEL_318 LABEL_319 LABEL_32 LABEL_320 LABEL_321 LABEL_322 LABEL_323 LABEL_324 LABEL_325 LABEL_326 LABEL_327 LABEL_328 LABEL_329 LABEL_33 LABEL_330 LABEL_331 LABEL_332 LABEL_333 LABEL_334 LABEL_335 LABEL_336 LABEL_337 LABEL_338 LABEL_339 LABEL_34 LABEL_340 LABEL_341 LABEL_342 LABEL_343 LABEL_344 LABEL_345 LABEL_346 LABEL_347 LABEL_348 LABEL_349 LABEL_35 LABEL_350 LABEL_351 LABEL_352 LABEL_353 LABEL_354 LABEL_355 LABEL_356 LABEL_357 LABEL_358 LABEL_359 LABEL_36 LABEL_360 LABEL_361 LABEL_362 LABEL_363 LABEL_364 LABEL_365 LABEL_366 LABEL_367 LABEL_368 LABEL_369 LABEL_37 LABEL_370 LABEL_371 LABEL_372 LABEL_373 LABEL_374 LABEL_375 LABEL_376 LABEL_377 LABEL_378 LABEL_379 LABEL_38 LABEL_380 LABEL_381 LABEL_382 LABEL_383 LABEL_384 LABEL_385 LABEL_386 LABEL_387 LABEL_388 LABEL_389 LABEL_39 LABEL_390 LABEL_391 LABEL_392 LABEL_393 LABEL_394 LABEL_395 LABEL_396 LABEL_397 LABEL_398 LABEL_399 LABEL_4 LABEL_40 LABEL_400 LABEL_401 LABEL_402 LABEL_403 LABEL_404 LABEL_405 LABEL_406 LABEL_407 LABEL_408 LABEL_409 LABEL_41 LABEL_410 LABEL_411 LABEL_412 LABEL_413 LABEL_414 LABEL_415 LABEL_416 LABEL_417 LABEL_418 LABEL_419 LABEL_42 LABEL_420 LABEL_421 LABEL_422 LABEL_423 LABEL_424 LABEL_425 LABEL_426 LABEL_427 LABEL_428 LABEL_429 LABEL_43 LABEL_430 LABEL_431 LABEL_432 LABEL_433 LABEL_434 LABEL_435 LABEL_436 LABEL_437 LABEL_438 LABEL_439 LABEL_44 LABEL_440 LABEL_441 LABEL_442 LABEL_443 LABEL_444 LABEL_445 LABEL_446 LABEL_447 LABEL_448 LABEL_449 LABEL_45 LABEL_450 LABEL_451 LABEL_452 LABEL_453 LABEL_454 LABEL_455 LABEL_456 LABEL_457 LABEL_458 LABEL_459 LABEL_46 LABEL_460 LABEL_461 LABEL_462 LABEL_463 LABEL_464 LABEL_465 LABEL_466 LABEL_467 LABEL_468 LABEL_469 LABEL_47 LABEL_470 LABEL_471 LABEL_472 LABEL_473 LABEL_474 LABEL_475 LABEL_476 LABEL_477 LABEL_478 LABEL_479 LABEL_48 LABEL_480 LABEL_481 LABEL_482 LABEL_483 LABEL_484 LABEL_485 LABEL_486 LABEL_487 LABEL_488 LABEL_489 LABEL_49 LABEL_490 LABEL_491 LABEL_492 LABEL_493 LABEL_494 LABEL_495 LABEL_496 LABEL_497 LABEL_498 LABEL_499 LABEL_5 LABEL_50 LABEL_500 LABEL_501 LABEL_502 LABEL_503 LABEL_504 LABEL_505 LABEL_506 LABEL_507 LABEL_508 LABEL_509 LABEL_51 LABEL_510 LABEL_511 LABEL_512 LABEL_513 LABEL_514 LABEL_515 LABEL_516 LABEL_517 LABEL_518 LABEL_519 LABEL_52 LABEL_520 LABEL_521 LABEL_522 LABEL_523 LABEL_524 LABEL_525 LABEL_526 LABEL_527 LABEL_528 LABEL_529 LABEL_53 LABEL_530 LABEL_531 LABEL_532 LABEL_533 LABEL_534 LABEL_535 LABEL_536 LABEL_537 LABEL_538 LABEL_539 LABEL_54 LABEL_540 LABEL_541 LABEL_542 LABEL_543 LABEL_544 LABEL_545 LABEL_546 LABEL_547 LABEL_548 LABEL_549 LABEL_55 LABEL_550 LABEL_551 LABEL_552 LABEL_553 LABEL_554 LABEL_555 LABEL_556 LABEL_557 LABEL_558 LABEL_559 LABEL_56 LABEL_560 LABEL_561 LABEL_562 LABEL_563 LABEL_564 LABEL_565 LABEL_566 LABEL_567 LABEL_568 LABEL_569 LABEL_57 LABEL_570 LABEL_571 LABEL_572 LABEL_573 LABEL_574 LABEL_575 LABEL_576 LABEL_577 LABEL_578 LABEL_579 LABEL_58 LABEL_580 LABEL_581 LABEL_582 LABEL_583 LABEL_584 LABEL_585 LABEL_586 LABEL_587 LABEL_588 LABEL_589 LABEL_59 LABEL_590 LABEL_591 LABEL_592 LABEL_593 LABEL_594 LABEL_595 LABEL_596 LABEL_597 LABEL_598 LABEL_599 LABEL_6 LABEL_60 LABEL_600 LABEL_601 LABEL_602 LABEL_603 LABEL_604 LABEL_605 LABEL_606 LABEL_607 LABEL_608 LABEL_609 LABEL_61 LABEL_610 LABEL_611 LABEL_612 LABEL_613 LABEL_614 LABEL_615 LABEL_616 LABEL_617 LABEL_618 LABEL_619 LABEL_62 LABEL_620 LABEL_621 LABEL_622 LABEL_623 LABEL_624 LABEL_625 LABEL_626 LABEL_627 LABEL_628 LABEL_63 LABEL_64 LABEL_65 LABEL_66 LABEL_67 LABEL_68 LABEL_69 LABEL_7 LABEL_70 LABEL_71 LABEL_72 LABEL_73 LABEL_74 LABEL_75 LABEL_76 LABEL_77 LABEL_78 LABEL_79 LABEL_8 LABEL_80 LABEL_81 LABEL_82 LABEL_83 LABEL_84 LABEL_85 LABEL_86 LABEL_87 LABEL_88 LABEL_89 LABEL_9 LABEL_90 LABEL_91 LABEL_92 LABEL_93 LABEL_94 LABEL_95 LABEL_96 LABEL_97 LABEL_98 LABEL_99
---
license: gpl-3.0
tags:
- generated_from_trainer
metrics:
- accuracy
model-index:
- name: IceBERT-finetuned
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# IceBERT-finetuned

This model is a fine-tuned version of [vesteinn/IceBERT](https://huggingface.co/vesteinn/IceBERT) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 3.7361
- Accuracy: 0.352

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 2e-05
- train_batch_size: 16
- eval_batch_size: 16
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 5

### Training results

| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|:-------------:|:-----:|:----:|:---------------:|:--------:|
| 4.5309        | 1.0   | 563  | 4.1093          | 0.329    |
| 3.9723        | 2.0   | 1126 | 3.8339          | 0.344    |
| 3.6949        | 3.0   | 1689 | 3.7490          | 0.346    |
| 3.5124        | 4.0   | 2252 | 3.7488          | 0.358    |
| 3.3763        | 5.0   | 2815 | 3.7361          | 0.352    |


### Framework versions

- Transformers 4.12.5
- Pytorch 1.10.0+cu111
- Datasets 1.15.1
- Tokenizers 0.10.3
