End of training

README.md

@@ -0,0 +1,113 @@
+---
+license: apache-2.0
+base_model: facebook/wav2vec2-large-xlsr-53
+tags:
+- generated_from_trainer
+metrics:
+- wer
+model-index:
+- name: wav2vec2-large-xlsr-demo
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# wav2vec2-large-xlsr-demo
+
+This model is a fine-tuned version of [facebook/wav2vec2-large-xlsr-53](https://huggingface.co/facebook/wav2vec2-large-xlsr-53) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.6751
+- Wer: 0.7846
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 0.0001
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_steps: 1000
+- num_epochs: 30
+- mixed_precision_training: Native AMP
+
+### Training results
+
+| Training Loss | Epoch   | Step  | Validation Loss | Wer    |
+|:-------------:|:-------:|:-----:|:---------------:|:------:|
+| 10.5108       | 0.5701  | 500   | 15.4314         | 1.0    |
+| 5.61          | 1.1403  | 1000  | 11.3143         | 1.0    |
+| 5.546         | 1.7104  | 1500  | 9.6388          | 1.0    |
+| 5.1105        | 2.2805  | 2000  | 5.9376          | 1.0    |
+| 4.9007        | 2.8506  | 2500  | 5.7582          | 1.0    |
+| 4.5876        | 3.4208  | 3000  | 6.7190          | 1.0    |
+| 4.3145        | 3.9909  | 3500  | 4.6527          | 1.0    |
+| 3.5332        | 4.5610  | 4000  | 3.3622          | 1.0011 |
+| 2.9071        | 5.1311  | 4500  | 2.7400          | 1.0176 |
+| 2.5077        | 5.7013  | 5000  | 2.8219          | 0.9460 |
+| 2.4145        | 6.2714  | 5500  | 2.4336          | 0.9570 |
+| 2.2432        | 6.8415  | 6000  | 2.1500          | 0.9169 |
+| 2.1376        | 7.4116  | 6500  | 2.1445          | 0.8930 |
+| 2.0841        | 7.9818  | 7000  | 2.1312          | 0.8864 |
+| 1.8288        | 8.5519  | 7500  | 1.9040          | 0.8728 |
+| 1.6863        | 9.1220  | 8000  | 1.8913          | 0.8434 |
+| 1.7453        | 9.6921  | 8500  | 2.1214          | 0.8507 |
+| 1.6896        | 10.2623 | 9000  | 1.8329          | 0.8548 |
+| 1.6063        | 10.8324 | 9500  | 1.8248          | 0.8386 |
+| 1.3838        | 11.4025 | 10000 | 1.7811          | 0.8379 |
+| 1.5255        | 11.9726 | 10500 | 2.3148          | 0.8390 |
+| 1.4269        | 12.5428 | 11000 | 2.1530          | 0.8184 |
+| 1.3452        | 13.1129 | 11500 | 1.7208          | 0.8221 |
+| 1.35          | 13.6830 | 12000 | 1.8269          | 0.8290 |
+| 1.3656        | 14.2531 | 12500 | 1.6902          | 0.8313 |
+| 1.2036        | 14.8233 | 13000 | 2.0816          | 0.8206 |
+| 1.2144        | 15.3934 | 13500 | 1.7623          | 0.8103 |
+| 1.1648        | 15.9635 | 14000 | 1.7197          | 0.8154 |
+| 1.1341        | 16.5336 | 14500 | 1.7560          | 0.8110 |
+| 1.0716        | 17.1038 | 15000 | 1.7750          | 0.8099 |
+| 1.1187        | 17.6739 | 15500 | 1.7946          | 0.8180 |
+| 1.0633        | 18.2440 | 16000 | 1.7877          | 0.7996 |
+| 1.0069        | 18.8141 | 16500 | 1.8482          | 0.8243 |
+| 0.9703        | 19.3843 | 17000 | 1.6073          | 0.7960 |
+| 1.0122        | 19.9544 | 17500 | 1.7191          | 0.8099 |
+| 0.9993        | 20.5245 | 18000 | 1.7208          | 0.7956 |
+| 0.9861        | 21.0946 | 18500 | 1.6628          | 0.7949 |
+| 0.9621        | 21.6648 | 19000 | 1.7685          | 0.7930 |
+| 0.8936        | 22.2349 | 19500 | 1.7232          | 0.8026 |
+| 0.888         | 22.8050 | 20000 | 1.7204          | 0.8015 |
+| 0.9027        | 23.3751 | 20500 | 1.7844          | 0.7923 |
+| 0.8808        | 23.9453 | 21000 | 1.7159          | 0.7945 |
+| 0.8652        | 24.5154 | 21500 | 1.6887          | 0.7934 |
+| 0.7545        | 25.0855 | 22000 | 1.6633          | 0.7937 |
+| 0.7664        | 25.6556 | 22500 | 1.6745          | 0.7919 |
+| 0.7518        | 26.2258 | 23000 | 1.7122          | 0.7930 |
+| 0.8475        | 26.7959 | 23500 | 1.6901          | 0.7868 |
+| 0.7527        | 27.3660 | 24000 | 1.6937          | 0.7835 |
+| 0.7531        | 27.9361 | 24500 | 1.6835          | 0.7820 |
+| 0.7686        | 28.5063 | 25000 | 1.6734          | 0.7901 |
+| 0.7525        | 29.0764 | 25500 | 1.6766          | 0.7868 |
+| 0.7765        | 29.6465 | 26000 | 1.6751          | 0.7846 |
+
+
+### Framework versions
+
+- Transformers 4.41.2
+- Pytorch 2.3.0
+- Datasets 2.19.2
+- Tokenizers 0.19.1

config.json

@@ -0,0 +1,117 @@
+{
+  "_name_or_path": "facebook/wav2vec2-large-xlsr-53",
+  "activation_dropout": 0.0,
+  "adapter_attn_dim": null,
+  "adapter_kernel_size": 3,
+  "adapter_stride": 2,
+  "add_adapter": false,
+  "apply_spec_augment": true,
+  "architectures": [
+    "Wav2Vec2ForCTC"
+  ],
+  "attention_dropout": 0.1,
+  "bos_token_id": 1,
+  "classifier_proj_size": 256,
+  "codevector_dim": 768,
+  "contrastive_logits_temperature": 0.1,
+  "conv_bias": true,
+  "conv_dim": [
+    512,
+    512,
+    512,
+    512,
+    512,
+    512,
+    512
+  ],
+  "conv_kernel": [
+    10,
+    3,
+    3,
+    3,
+    3,
+    2,
+    2
+  ],
+  "conv_stride": [
+    5,
+    2,
+    2,
+    2,
+    2,
+    2,
+    2
+  ],
+  "ctc_loss_reduction": "mean",
+  "ctc_zero_infinity": false,
+  "diversity_loss_weight": 0.1,
+  "do_stable_layer_norm": true,
+  "eos_token_id": 2,
+  "feat_extract_activation": "gelu",
+  "feat_extract_dropout": 0.0,
+  "feat_extract_norm": "layer",
+  "feat_proj_dropout": 0.0,
+  "feat_quantizer_dropout": 0.0,
+  "final_dropout": 0.0,
+  "gradient_checkpointing": false,
+  "hidden_act": "gelu",
+  "hidden_dropout": 0.1,
+  "hidden_size": 1024,
+  "initializer_range": 0.02,
+  "intermediate_size": 4096,
+  "layer_norm_eps": 1e-05,
+  "layerdrop": 0.1,
+  "mask_channel_length": 10,
+  "mask_channel_min_space": 1,
+  "mask_channel_other": 0.0,
+  "mask_channel_prob": 0.0,
+  "mask_channel_selection": "static",
+  "mask_feature_length": 10,
+  "mask_feature_min_masks": 0,
+  "mask_feature_prob": 0.0,
+  "mask_time_length": 10,
+  "mask_time_min_masks": 2,
+  "mask_time_min_space": 1,
+  "mask_time_other": 0.0,
+  "mask_time_prob": 0.05,
+  "mask_time_selection": "static",
+  "model_type": "wav2vec2",
+  "num_adapter_layers": 3,
+  "num_attention_heads": 16,
+  "num_codevector_groups": 2,
+  "num_codevectors_per_group": 320,
+  "num_conv_pos_embedding_groups": 16,
+  "num_conv_pos_embeddings": 128,
+  "num_feat_extract_layers": 7,
+  "num_hidden_layers": 24,
+  "num_negatives": 100,
+  "output_hidden_size": 1024,
+  "pad_token_id": 1795,
+  "proj_codevector_dim": 768,
+  "tdnn_dilation": [
+    1,
+    2,
+    3,
+    1,
+    1
+  ],
+  "tdnn_dim": [
+    512,
+    512,
+    512,
+    512,
+    1500
+  ],
+  "tdnn_kernel": [
+    5,
+    3,
+    3,
+    1,
+    1
+  ],
+  "torch_dtype": "float32",
+  "transformers_version": "4.41.2",
+  "use_weighted_layer_sum": false,
+  "vocab_size": 1798,
+  "xvector_output_dim": 512
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1f47f3c1983d36e0f2a770863f3f66434cbc3f93847fa65728b12945ab1d1419
+size 1269179304

preprocessor_config.json

@@ -0,0 +1,9 @@
+{
+  "do_normalize": true,
+  "feature_extractor_type": "Wav2Vec2FeatureExtractor",
+  "feature_size": 1,
+  "padding_side": "right",
+  "padding_value": 0.0,
+  "return_attention_mask": false,
+  "sampling_rate": 16000
+}

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ed80096d79b2a970dabf27215de4e699424f008cf8c0a579f5431ce8a89e5673
+size 5048