--- tags: - automatic-speech-recognition - gary109/AI_Light_Dance - generated_from_trainer datasets: - ai_light_dance metrics: - wer model-index: - name: ai-light-dance_drums_ft_pretrain_wav2vec2-base-new_onset-idmt-2 results: [] --- # ai-light-dance_drums_ft_pretrain_wav2vec2-base-new_onset-idmt-2 This model is a fine-tuned version of [gary109/ai-light-dance_drums_ft_pretrain_wav2vec2-base-new_onset-idmt-2](https://huggingface.co/gary109/ai-light-dance_drums_ft_pretrain_wav2vec2-base-new_onset-idmt-2) on the GARY109/AI_LIGHT_DANCE - ONSET-IDMT-2 dataset. It achieves the following results on the evaluation set: - Loss: 0.2794 - Wer: 0.2733 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 0.0003 - train_batch_size: 4 - eval_batch_size: 4 - seed: 42 - gradient_accumulation_steps: 4 - total_train_batch_size: 16 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - lr_scheduler_warmup_steps: 30 - num_epochs: 100.0 - mixed_precision_training: Native AMP ### Training results | Training Loss | Epoch | Step | Validation Loss | Wer | |:-------------:|:-----:|:----:|:---------------:|:------:| | No log | 1.0 | 9 | 0.3089 | 0.2856 | | 0.2871 | 2.0 | 18 | 0.3208 | 0.28 | | 0.2997 | 3.0 | 27 | 0.3948 | 0.2878 | | 0.299 | 4.0 | 36 | 0.3137 | 0.3011 | | 0.3462 | 5.0 | 45 | 0.3067 | 0.2689 | | 0.3098 | 6.0 | 54 | 0.3271 | 0.2811 | | 0.2812 | 7.0 | 63 | 0.4907 | 0.26 | | 0.3151 | 8.0 | 72 | 0.5852 | 0.2778 | | 0.3038 | 9.0 | 81 | 0.2981 | 0.2767 | | 0.3248 | 10.0 | 90 | 0.3129 | 0.2811 | | 0.3248 | 11.0 | 99 | 0.4090 | 0.2767 | | 0.3106 | 12.0 | 108 | 0.5354 | 0.3 | | 0.2702 | 13.0 | 117 | 0.5543 | 0.3 | | 0.3021 | 14.0 | 126 | 0.5437 | 0.2689 | | 0.2622 | 15.0 | 135 | 0.5898 | 0.2778 | | 0.2465 | 16.0 | 144 | 0.2900 | 0.2722 | | 0.3077 | 17.0 | 153 | 0.4407 | 0.2544 | | 0.2959 | 18.0 | 162 | 0.4079 | 0.2944 | | 0.2843 | 19.0 | 171 | 0.5042 | 0.2722 | | 0.254 | 20.0 | 180 | 0.3851 | 0.2878 | | 0.254 | 21.0 | 189 | 0.3912 | 0.2678 | | 0.2532 | 22.0 | 198 | 0.4699 | 0.2578 | | 0.3011 | 23.0 | 207 | 0.7466 | 0.2744 | | 0.2601 | 24.0 | 216 | 0.4238 | 0.28 | | 0.2873 | 25.0 | 225 | 0.3817 | 0.2456 | | 0.2791 | 26.0 | 234 | 0.3488 | 0.2489 | | 0.2399 | 27.0 | 243 | 0.2980 | 0.2611 | | 0.2592 | 28.0 | 252 | 0.2942 | 0.27 | | 0.2191 | 29.0 | 261 | 0.2921 | 0.2833 | | 0.2285 | 30.0 | 270 | 0.2851 | 0.2744 | | 0.2285 | 31.0 | 279 | 0.2794 | 0.2733 | | 0.2489 | 32.0 | 288 | 0.3036 | 0.2678 | | 0.2445 | 33.0 | 297 | 0.2851 | 0.2678 | | 0.2261 | 34.0 | 306 | 0.2864 | 0.2733 | | 0.2391 | 35.0 | 315 | 0.3055 | 0.2611 | | 0.3939 | 36.0 | 324 | 0.2927 | 0.26 | | 0.2521 | 37.0 | 333 | 0.3470 | 0.2578 | | 0.2378 | 38.0 | 342 | 0.2841 | 0.2656 | | 0.2653 | 39.0 | 351 | 0.2889 | 0.2389 | | 0.2235 | 40.0 | 360 | 0.3176 | 0.25 | | 0.2235 | 41.0 | 369 | 0.3188 | 0.2667 | | 0.2474 | 42.0 | 378 | 0.3782 | 0.2633 | | 0.222 | 43.0 | 387 | 0.3201 | 0.2767 | | 0.2411 | 44.0 | 396 | 0.3416 | 0.2722 | | 0.2561 | 45.0 | 405 | 0.3050 | 0.2711 | | 0.2169 | 46.0 | 414 | 0.3968 | 0.2511 | | 0.2296 | 47.0 | 423 | 0.3721 | 0.2567 | | 0.1989 | 48.0 | 432 | 0.3205 | 0.2667 | | 0.2408 | 49.0 | 441 | 0.4524 | 0.2489 | | 0.2163 | 50.0 | 450 | 0.4850 | 0.2567 | | 0.2163 | 51.0 | 459 | 0.3777 | 0.2711 | | 0.2001 | 52.0 | 468 | 0.5526 | 0.2644 | | 0.2373 | 53.0 | 477 | 0.5141 | 0.2589 | | 0.2132 | 54.0 | 486 | 0.5408 | 0.2611 | | 0.2687 | 55.0 | 495 | 0.5389 | 0.2678 | | 0.2244 | 56.0 | 504 | 0.5729 | 0.2578 | | 0.2102 | 57.0 | 513 | 0.6249 | 0.2489 | | 0.2076 | 58.0 | 522 | 0.5538 | 0.25 | | 0.208 | 59.0 | 531 | 0.5499 | 0.2467 | | 0.2167 | 60.0 | 540 | 0.6481 | 0.2433 | | 0.2167 | 61.0 | 549 | 0.6797 | 0.2589 | | 0.2218 | 62.0 | 558 | 0.5401 | 0.2656 | | 0.2102 | 63.0 | 567 | 0.5152 | 0.26 | | 0.2176 | 64.0 | 576 | 0.5581 | 0.26 | | 0.2068 | 65.0 | 585 | 0.7225 | 0.2533 | | 0.2123 | 66.0 | 594 | 0.6330 | 0.2633 | | 0.2212 | 67.0 | 603 | 0.5943 | 0.2589 | | 0.2013 | 68.0 | 612 | 0.7557 | 0.25 | | 0.2304 | 69.0 | 621 | 0.9144 | 0.2467 | | 0.209 | 70.0 | 630 | 0.7790 | 0.24 | | 0.209 | 71.0 | 639 | 0.6203 | 0.2411 | | 0.191 | 72.0 | 648 | 0.6280 | 0.2322 | | 0.2313 | 73.0 | 657 | 0.5491 | 0.2378 | | 0.1869 | 74.0 | 666 | 0.4653 | 0.2411 | | 0.2313 | 75.0 | 675 | 0.6016 | 0.2489 | | 0.1806 | 76.0 | 684 | 0.6492 | 0.2478 | | 0.1934 | 77.0 | 693 | 0.6185 | 0.2478 | | 0.1954 | 78.0 | 702 | 0.5618 | 0.2489 | | 0.2077 | 79.0 | 711 | 0.5760 | 0.2522 | | 0.2052 | 80.0 | 720 | 0.6172 | 0.25 | | 0.2052 | 81.0 | 729 | 0.6859 | 0.2467 | | 0.1804 | 82.0 | 738 | 0.7643 | 0.2422 | | 0.1995 | 83.0 | 747 | 0.8360 | 0.2367 | | 0.1869 | 84.0 | 756 | 0.6984 | 0.2489 | | 0.2135 | 85.0 | 765 | 0.6759 | 0.2422 | | 0.178 | 86.0 | 774 | 0.6791 | 0.2444 | | 0.1734 | 87.0 | 783 | 0.7284 | 0.2411 | | 0.1881 | 88.0 | 792 | 0.8172 | 0.2344 | | 0.1625 | 89.0 | 801 | 0.8061 | 0.2356 | | 0.181 | 90.0 | 810 | 0.7644 | 0.2389 | | 0.181 | 91.0 | 819 | 0.7413 | 0.24 | | 0.1942 | 92.0 | 828 | 0.6439 | 0.2433 | | 0.1806 | 93.0 | 837 | 0.6250 | 0.2467 | | 0.1651 | 94.0 | 846 | 0.6517 | 0.2433 | | 0.1833 | 95.0 | 855 | 0.6628 | 0.2389 | | 0.1873 | 96.0 | 864 | 0.6582 | 0.2378 | | 0.1672 | 97.0 | 873 | 0.6548 | 0.2389 | | 0.1871 | 98.0 | 882 | 0.6655 | 0.24 | | 0.2429 | 99.0 | 891 | 0.6695 | 0.24 | | 0.1832 | 100.0 | 900 | 0.6700 | 0.2389 | ### Framework versions - Transformers 4.25.0.dev0 - Pytorch 1.8.1+cu111 - Datasets 2.7.1.dev0 - Tokenizers 0.13.2