--- base_model: anderloh/Hugginhface-master-wav2vec-pretreined-5-class-train-test tags: - audio-classification - generated_from_trainer metrics: - accuracy model-index: - name: wav2vec2-5Class-Validation-Mobil results: [] --- # wav2vec2-5Class-Validation-Mobil This model is a fine-tuned version of [anderloh/Hugginhface-master-wav2vec-pretreined-5-class-train-test](https://huggingface.co/anderloh/Hugginhface-master-wav2vec-pretreined-5-class-train-test) on the anderloh/ValidateRes dataset. It achieves the following results on the evaluation set: - Loss: 1.2514 - Accuracy: 0.5836 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 3e-05 - train_batch_size: 128 - eval_batch_size: 128 - seed: 0 - gradient_accumulation_steps: 4 - total_train_batch_size: 512 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - lr_scheduler_warmup_ratio: 0.1 - num_epochs: 300.0 - mixed_precision_training: Native AMP ### Training results | Training Loss | Epoch | Step | Validation Loss | Accuracy | |:-------------:|:------:|:----:|:---------------:|:--------:| | No log | 0.92 | 3 | 1.6024 | 0.3203 | | No log | 1.85 | 6 | 1.6022 | 0.3167 | | No log | 2.77 | 9 | 1.6020 | 0.3167 | | No log | 4.0 | 13 | 1.6015 | 0.3167 | | No log | 4.92 | 16 | 1.6009 | 0.3167 | | No log | 5.85 | 19 | 1.6003 | 0.3132 | | No log | 6.77 | 22 | 1.5996 | 0.3060 | | No log | 8.0 | 26 | 1.5984 | 0.2989 | | No log | 8.92 | 29 | 1.5974 | 0.2918 | | No log | 9.85 | 32 | 1.5964 | 0.2740 | | No log | 10.77 | 35 | 1.5952 | 0.2598 | | No log | 12.0 | 39 | 1.5934 | 0.2633 | | No log | 12.92 | 42 | 1.5920 | 0.2740 | | No log | 13.85 | 45 | 1.5905 | 0.2989 | | No log | 14.77 | 48 | 1.5889 | 0.2989 | | No log | 16.0 | 52 | 1.5868 | 0.2847 | | No log | 16.92 | 55 | 1.5851 | 0.2847 | | No log | 17.85 | 58 | 1.5833 | 0.2847 | | No log | 18.77 | 61 | 1.5816 | 0.2633 | | No log | 20.0 | 65 | 1.5790 | 0.2456 | | No log | 20.92 | 68 | 1.5770 | 0.2420 | | No log | 21.85 | 71 | 1.5748 | 0.2349 | | No log | 22.77 | 74 | 1.5728 | 0.2313 | | No log | 24.0 | 78 | 1.5699 | 0.2278 | | No log | 24.92 | 81 | 1.5678 | 0.2313 | | No log | 25.85 | 84 | 1.5657 | 0.2313 | | No log | 26.77 | 87 | 1.5638 | 0.2313 | | No log | 28.0 | 91 | 1.5613 | 0.2313 | | No log | 28.92 | 94 | 1.5597 | 0.2313 | | No log | 29.85 | 97 | 1.5588 | 0.2313 | | 1.561 | 30.77 | 100 | 1.5586 | 0.2313 | | 1.561 | 32.0 | 104 | 1.5597 | 0.2313 | | 1.561 | 32.92 | 107 | 1.5619 | 0.2313 | | 1.561 | 33.85 | 110 | 1.5661 | 0.2313 | | 1.561 | 34.77 | 113 | 1.5720 | 0.2313 | | 1.561 | 36.0 | 117 | 1.5833 | 0.2313 | | 1.561 | 36.92 | 120 | 1.5957 | 0.2313 | | 1.561 | 37.85 | 123 | 1.6120 | 0.2313 | | 1.561 | 38.77 | 126 | 1.6318 | 0.2313 | | 1.561 | 40.0 | 130 | 1.6638 | 0.2313 | | 1.561 | 40.92 | 133 | 1.6905 | 0.2313 | | 1.561 | 41.85 | 136 | 1.7197 | 0.2313 | | 1.561 | 42.77 | 139 | 1.7503 | 0.2313 | | 1.561 | 44.0 | 143 | 1.7803 | 0.2313 | | 1.561 | 44.92 | 146 | 1.7917 | 0.2313 | | 1.561 | 45.85 | 149 | 1.7920 | 0.2313 | | 1.561 | 46.77 | 152 | 1.7869 | 0.2313 | | 1.561 | 48.0 | 156 | 1.7700 | 0.2598 | | 1.561 | 48.92 | 159 | 1.7525 | 0.2740 | | 1.561 | 49.85 | 162 | 1.7407 | 0.2776 | | 1.561 | 50.77 | 165 | 1.7307 | 0.2918 | | 1.561 | 52.0 | 169 | 1.7241 | 0.3096 | | 1.561 | 52.92 | 172 | 1.7243 | 0.3167 | | 1.561 | 53.85 | 175 | 1.7254 | 0.3167 | | 1.561 | 54.77 | 178 | 1.7233 | 0.3238 | | 1.561 | 56.0 | 182 | 1.7225 | 0.3238 | | 1.561 | 56.92 | 185 | 1.7187 | 0.3274 | | 1.561 | 57.85 | 188 | 1.7172 | 0.3274 | | 1.561 | 58.77 | 191 | 1.7146 | 0.3345 | | 1.561 | 60.0 | 195 | 1.7120 | 0.3488 | | 1.561 | 60.92 | 198 | 1.7049 | 0.3559 | | 1.3094 | 61.85 | 201 | 1.7022 | 0.3594 | | 1.3094 | 62.77 | 204 | 1.6912 | 0.3737 | | 1.3094 | 64.0 | 208 | 1.6798 | 0.3772 | | 1.3094 | 64.92 | 211 | 1.6687 | 0.3808 | | 1.3094 | 65.85 | 214 | 1.6569 | 0.3843 | | 1.3094 | 66.77 | 217 | 1.6427 | 0.3915 | | 1.3094 | 68.0 | 221 | 1.6301 | 0.3915 | | 1.3094 | 68.92 | 224 | 1.6217 | 0.3950 | | 1.3094 | 69.85 | 227 | 1.6203 | 0.3950 | | 1.3094 | 70.77 | 230 | 1.6257 | 0.3950 | | 1.3094 | 72.0 | 234 | 1.6192 | 0.4021 | | 1.3094 | 72.92 | 237 | 1.6044 | 0.4093 | | 1.3094 | 73.85 | 240 | 1.5868 | 0.4306 | | 1.3094 | 74.77 | 243 | 1.5787 | 0.4377 | | 1.3094 | 76.0 | 247 | 1.5762 | 0.4342 | | 1.3094 | 76.92 | 250 | 1.5717 | 0.4377 | | 1.3094 | 77.85 | 253 | 1.5674 | 0.4342 | | 1.3094 | 78.77 | 256 | 1.5684 | 0.4270 | | 1.3094 | 80.0 | 260 | 1.5619 | 0.4270 | | 1.3094 | 80.92 | 263 | 1.5555 | 0.4306 | | 1.3094 | 81.85 | 266 | 1.5505 | 0.4342 | | 1.3094 | 82.77 | 269 | 1.5386 | 0.4413 | | 1.3094 | 84.0 | 273 | 1.5362 | 0.4377 | | 1.3094 | 84.92 | 276 | 1.5411 | 0.4342 | | 1.3094 | 85.85 | 279 | 1.5453 | 0.4342 | | 1.3094 | 86.77 | 282 | 1.5611 | 0.4270 | | 1.3094 | 88.0 | 286 | 1.5766 | 0.4199 | | 1.3094 | 88.92 | 289 | 1.5781 | 0.4199 | | 1.3094 | 89.85 | 292 | 1.5675 | 0.4235 | | 1.3094 | 90.77 | 295 | 1.5588 | 0.4270 | | 1.3094 | 92.0 | 299 | 1.5496 | 0.4270 | | 1.0538 | 92.92 | 302 | 1.5493 | 0.4270 | | 1.0538 | 93.85 | 305 | 1.5540 | 0.4235 | | 1.0538 | 94.77 | 308 | 1.5620 | 0.4164 | | 1.0538 | 96.0 | 312 | 1.5648 | 0.4164 | | 1.0538 | 96.92 | 315 | 1.5617 | 0.4164 | | 1.0538 | 97.85 | 318 | 1.5461 | 0.4235 | | 1.0538 | 98.77 | 321 | 1.5348 | 0.4306 | | 1.0538 | 100.0 | 325 | 1.5346 | 0.4306 | | 1.0538 | 100.92 | 328 | 1.5466 | 0.4164 | | 1.0538 | 101.85 | 331 | 1.5547 | 0.4128 | | 1.0538 | 102.77 | 334 | 1.5560 | 0.4128 | | 1.0538 | 104.0 | 338 | 1.5315 | 0.4306 | | 1.0538 | 104.92 | 341 | 1.5124 | 0.4448 | | 1.0538 | 105.85 | 344 | 1.5044 | 0.4448 | | 1.0538 | 106.77 | 347 | 1.5010 | 0.4484 | | 1.0538 | 108.0 | 351 | 1.5005 | 0.4448 | | 1.0538 | 108.92 | 354 | 1.4992 | 0.4448 | | 1.0538 | 109.85 | 357 | 1.4994 | 0.4484 | | 1.0538 | 110.77 | 360 | 1.4988 | 0.4520 | | 1.0538 | 112.0 | 364 | 1.5005 | 0.4662 | | 1.0538 | 112.92 | 367 | 1.5010 | 0.4733 | | 1.0538 | 113.85 | 370 | 1.4969 | 0.4698 | | 1.0538 | 114.77 | 373 | 1.4776 | 0.4733 | | 1.0538 | 116.0 | 377 | 1.4528 | 0.4769 | | 1.0538 | 116.92 | 380 | 1.4395 | 0.4947 | | 1.0538 | 117.85 | 383 | 1.4310 | 0.4982 | | 1.0538 | 118.77 | 386 | 1.4315 | 0.4947 | | 1.0538 | 120.0 | 390 | 1.4389 | 0.4947 | | 1.0538 | 120.92 | 393 | 1.4375 | 0.4982 | | 1.0538 | 121.85 | 396 | 1.4381 | 0.4982 | | 1.0538 | 122.77 | 399 | 1.4247 | 0.4982 | | 0.8509 | 124.0 | 403 | 1.4196 | 0.4982 | | 0.8509 | 124.92 | 406 | 1.4179 | 0.5053 | | 0.8509 | 125.85 | 409 | 1.4091 | 0.5053 | | 0.8509 | 126.77 | 412 | 1.3958 | 0.5053 | | 0.8509 | 128.0 | 416 | 1.3736 | 0.5089 | | 0.8509 | 128.92 | 419 | 1.3661 | 0.5089 | | 0.8509 | 129.85 | 422 | 1.3694 | 0.5125 | | 0.8509 | 130.77 | 425 | 1.3808 | 0.5125 | | 0.8509 | 132.0 | 429 | 1.3819 | 0.5125 | | 0.8509 | 132.92 | 432 | 1.3859 | 0.5125 | | 0.8509 | 133.85 | 435 | 1.3780 | 0.5231 | | 0.8509 | 134.77 | 438 | 1.3696 | 0.5231 | | 0.8509 | 136.0 | 442 | 1.3564 | 0.5302 | | 0.8509 | 136.92 | 445 | 1.3421 | 0.5338 | | 0.8509 | 137.85 | 448 | 1.3256 | 0.5374 | | 0.8509 | 138.77 | 451 | 1.3274 | 0.5374 | | 0.8509 | 140.0 | 455 | 1.3402 | 0.5409 | | 0.8509 | 140.92 | 458 | 1.3517 | 0.5409 | | 0.8509 | 141.85 | 461 | 1.3585 | 0.5409 | | 0.8509 | 142.77 | 464 | 1.3592 | 0.5374 | | 0.8509 | 144.0 | 468 | 1.3329 | 0.5480 | | 0.8509 | 144.92 | 471 | 1.3126 | 0.5480 | | 0.8509 | 145.85 | 474 | 1.3076 | 0.5445 | | 0.8509 | 146.77 | 477 | 1.3146 | 0.5480 | | 0.8509 | 148.0 | 481 | 1.3345 | 0.5445 | | 0.8509 | 148.92 | 484 | 1.3409 | 0.5445 | | 0.8509 | 149.85 | 487 | 1.3374 | 0.5445 | | 0.8509 | 150.77 | 490 | 1.3227 | 0.5480 | | 0.8509 | 152.0 | 494 | 1.3201 | 0.5445 | | 0.8509 | 152.92 | 497 | 1.3174 | 0.5445 | | 0.7118 | 153.85 | 500 | 1.3073 | 0.5445 | | 0.7118 | 154.77 | 503 | 1.2984 | 0.5552 | | 0.7118 | 156.0 | 507 | 1.2975 | 0.5516 | | 0.7118 | 156.92 | 510 | 1.3027 | 0.5516 | | 0.7118 | 157.85 | 513 | 1.3089 | 0.5480 | | 0.7118 | 158.77 | 516 | 1.3139 | 0.5480 | | 0.7118 | 160.0 | 520 | 1.3068 | 0.5552 | | 0.7118 | 160.92 | 523 | 1.3011 | 0.5552 | | 0.7118 | 161.85 | 526 | 1.2957 | 0.5552 | | 0.7118 | 162.77 | 529 | 1.2960 | 0.5552 | | 0.7118 | 164.0 | 533 | 1.3159 | 0.5516 | | 0.7118 | 164.92 | 536 | 1.3257 | 0.5516 | | 0.7118 | 165.85 | 539 | 1.3312 | 0.5516 | | 0.7118 | 166.77 | 542 | 1.3222 | 0.5516 | | 0.7118 | 168.0 | 546 | 1.2986 | 0.5552 | | 0.7118 | 168.92 | 549 | 1.2898 | 0.5587 | | 0.7118 | 169.85 | 552 | 1.2938 | 0.5552 | | 0.7118 | 170.77 | 555 | 1.2902 | 0.5552 | | 0.7118 | 172.0 | 559 | 1.2879 | 0.5658 | | 0.7118 | 172.92 | 562 | 1.2838 | 0.5658 | | 0.7118 | 173.85 | 565 | 1.2812 | 0.5658 | | 0.7118 | 174.77 | 568 | 1.2864 | 0.5658 | | 0.7118 | 176.0 | 572 | 1.2934 | 0.5552 | | 0.7118 | 176.92 | 575 | 1.2940 | 0.5587 | | 0.7118 | 177.85 | 578 | 1.2988 | 0.5587 | | 0.7118 | 178.77 | 581 | 1.2953 | 0.5623 | | 0.7118 | 180.0 | 585 | 1.2972 | 0.5587 | | 0.7118 | 180.92 | 588 | 1.2936 | 0.5658 | | 0.7118 | 181.85 | 591 | 1.2928 | 0.5658 | | 0.7118 | 182.77 | 594 | 1.2913 | 0.5658 | | 0.7118 | 184.0 | 598 | 1.2825 | 0.5658 | | 0.6473 | 184.92 | 601 | 1.2736 | 0.5694 | | 0.6473 | 185.85 | 604 | 1.2715 | 0.5694 | | 0.6473 | 186.77 | 607 | 1.2704 | 0.5694 | | 0.6473 | 188.0 | 611 | 1.2717 | 0.5694 | | 0.6473 | 188.92 | 614 | 1.2724 | 0.5658 | | 0.6473 | 189.85 | 617 | 1.2763 | 0.5658 | | 0.6473 | 190.77 | 620 | 1.2812 | 0.5658 | | 0.6473 | 192.0 | 624 | 1.2791 | 0.5658 | | 0.6473 | 192.92 | 627 | 1.2698 | 0.5694 | | 0.6473 | 193.85 | 630 | 1.2695 | 0.5694 | | 0.6473 | 194.77 | 633 | 1.2704 | 0.5694 | | 0.6473 | 196.0 | 637 | 1.2737 | 0.5658 | | 0.6473 | 196.92 | 640 | 1.2782 | 0.5658 | | 0.6473 | 197.85 | 643 | 1.2814 | 0.5623 | | 0.6473 | 198.77 | 646 | 1.2819 | 0.5623 | | 0.6473 | 200.0 | 650 | 1.2746 | 0.5658 | | 0.6473 | 200.92 | 653 | 1.2694 | 0.5658 | | 0.6473 | 201.85 | 656 | 1.2625 | 0.5765 | | 0.6473 | 202.77 | 659 | 1.2575 | 0.5801 | | 0.6473 | 204.0 | 663 | 1.2549 | 0.5801 | | 0.6473 | 204.92 | 666 | 1.2623 | 0.5730 | | 0.6473 | 205.85 | 669 | 1.2665 | 0.5658 | | 0.6473 | 206.77 | 672 | 1.2684 | 0.5658 | | 0.6473 | 208.0 | 676 | 1.2770 | 0.5623 | | 0.6473 | 208.92 | 679 | 1.2808 | 0.5623 | | 0.6473 | 209.85 | 682 | 1.2762 | 0.5730 | | 0.6473 | 210.77 | 685 | 1.2759 | 0.5730 | | 0.6473 | 212.0 | 689 | 1.2752 | 0.5730 | | 0.6473 | 212.92 | 692 | 1.2754 | 0.5730 | | 0.6473 | 213.85 | 695 | 1.2722 | 0.5765 | | 0.6473 | 214.77 | 698 | 1.2739 | 0.5765 | | 0.613 | 216.0 | 702 | 1.2783 | 0.5765 | | 0.613 | 216.92 | 705 | 1.2775 | 0.5765 | | 0.613 | 217.85 | 708 | 1.2741 | 0.5765 | | 0.613 | 218.77 | 711 | 1.2706 | 0.5765 | | 0.613 | 220.0 | 715 | 1.2628 | 0.5765 | | 0.613 | 220.92 | 718 | 1.2581 | 0.5801 | | 0.613 | 221.85 | 721 | 1.2568 | 0.5765 | | 0.613 | 222.77 | 724 | 1.2559 | 0.5730 | | 0.613 | 224.0 | 728 | 1.2503 | 0.5765 | | 0.613 | 224.92 | 731 | 1.2498 | 0.5765 | | 0.613 | 225.85 | 734 | 1.2500 | 0.5765 | | 0.613 | 226.77 | 737 | 1.2490 | 0.5765 | | 0.613 | 228.0 | 741 | 1.2532 | 0.5765 | | 0.613 | 228.92 | 744 | 1.2572 | 0.5765 | | 0.613 | 229.85 | 747 | 1.2599 | 0.5765 | | 0.613 | 230.77 | 750 | 1.2601 | 0.5730 | | 0.613 | 232.0 | 754 | 1.2625 | 0.5730 | | 0.613 | 232.92 | 757 | 1.2636 | 0.5765 | | 0.613 | 233.85 | 760 | 1.2629 | 0.5765 | | 0.613 | 234.77 | 763 | 1.2600 | 0.5765 | | 0.613 | 236.0 | 767 | 1.2559 | 0.5801 | | 0.613 | 236.92 | 770 | 1.2534 | 0.5801 | | 0.613 | 237.85 | 773 | 1.2514 | 0.5836 | | 0.613 | 238.77 | 776 | 1.2508 | 0.5836 | | 0.613 | 240.0 | 780 | 1.2488 | 0.5836 | | 0.613 | 240.92 | 783 | 1.2483 | 0.5836 | | 0.613 | 241.85 | 786 | 1.2500 | 0.5836 | | 0.613 | 242.77 | 789 | 1.2504 | 0.5801 | | 0.613 | 244.0 | 793 | 1.2521 | 0.5801 | | 0.613 | 244.92 | 796 | 1.2533 | 0.5801 | | 0.613 | 245.85 | 799 | 1.2513 | 0.5801 | | 0.5946 | 246.77 | 802 | 1.2513 | 0.5801 | | 0.5946 | 248.0 | 806 | 1.2507 | 0.5801 | | 0.5946 | 248.92 | 809 | 1.2492 | 0.5836 | | 0.5946 | 249.85 | 812 | 1.2500 | 0.5801 | | 0.5946 | 250.77 | 815 | 1.2505 | 0.5801 | | 0.5946 | 252.0 | 819 | 1.2519 | 0.5801 | | 0.5946 | 252.92 | 822 | 1.2531 | 0.5801 | | 0.5946 | 253.85 | 825 | 1.2538 | 0.5801 | | 0.5946 | 254.77 | 828 | 1.2532 | 0.5801 | | 0.5946 | 256.0 | 832 | 1.2528 | 0.5801 | | 0.5946 | 256.92 | 835 | 1.2528 | 0.5801 | | 0.5946 | 257.85 | 838 | 1.2521 | 0.5836 | | 0.5946 | 258.77 | 841 | 1.2526 | 0.5836 | | 0.5946 | 260.0 | 845 | 1.2528 | 0.5836 | | 0.5946 | 260.92 | 848 | 1.2529 | 0.5836 | | 0.5946 | 261.85 | 851 | 1.2528 | 0.5836 | | 0.5946 | 262.77 | 854 | 1.2517 | 0.5836 | | 0.5946 | 264.0 | 858 | 1.2512 | 0.5836 | | 0.5946 | 264.92 | 861 | 1.2512 | 0.5836 | | 0.5946 | 265.85 | 864 | 1.2504 | 0.5836 | | 0.5946 | 266.77 | 867 | 1.2499 | 0.5836 | | 0.5946 | 268.0 | 871 | 1.2496 | 0.5836 | | 0.5946 | 268.92 | 874 | 1.2497 | 0.5836 | | 0.5946 | 269.85 | 877 | 1.2500 | 0.5836 | | 0.5946 | 270.77 | 880 | 1.2500 | 0.5836 | | 0.5946 | 272.0 | 884 | 1.2499 | 0.5836 | | 0.5946 | 272.92 | 887 | 1.2501 | 0.5836 | | 0.5946 | 273.85 | 890 | 1.2504 | 0.5836 | | 0.5946 | 274.77 | 893 | 1.2506 | 0.5836 | | 0.5946 | 276.0 | 897 | 1.2506 | 0.5836 | | 0.588 | 276.92 | 900 | 1.2506 | 0.5836 | ### Framework versions - Transformers 4.39.0.dev0 - Pytorch 2.2.1+cu121 - Datasets 2.17.1 - Tokenizers 0.15.2