Model save

README.md

@@ -0,0 +1,72 @@
+---
+base_model: nadsoft/hamsa_small
+tags:
+- generated_from_trainer
+metrics:
+- wer
+model-index:
+- name: hamsa-small-finetuned-qasr
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# hamsa-small-finetuned-qasr
+
+This model is a fine-tuned version of [nadsoft/hamsa_small](https://huggingface.co/nadsoft/hamsa_small) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.2832
+- Wer: 21.0114
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 1e-05
+- train_batch_size: 16
+- eval_batch_size: 16
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_steps: 500
+- training_steps: 7500
+- mixed_precision_training: Native AMP
+
+### Training results
+
+| Training Loss | Epoch | Step  | Validation Loss | Wer     |
+|:-------------:|:-----:|:-----:|:---------------:|:-------:|
+| 0.3207        | 0.03  | 2500  | 0.3458          | 24.4928 |
+| 0.3264        | 0.05  | 5000  | 0.3316          | 23.4082 |
+| 0.3223        | 0.08  | 7500  | 0.3239          | 25.1050 |
+| 0.3121        | 0.1   | 10000 | 0.3143          | 23.4557 |
+| 0.3103        | 0.13  | 12500 | 0.3079          | 23.4296 |
+| 0.3041        | 0.15  | 15000 | 0.3033          | 23.2113 |
+| 0.3077        | 0.18  | 17500 | 0.2998          | 21.7091 |
+| 0.2867        | 0.2   | 20000 | 0.2943          | 20.1761 |
+| 0.265         | 0.23  | 22500 | 0.2921          | 21.6522 |
+| 0.3096        | 0.25  | 25000 | 0.2894          | 22.1505 |
+| 0.2813        | 0.28  | 27500 | 0.2863          | 22.4993 |
+| 0.2805        | 0.3   | 30000 | 0.2832          | 21.0114 |
+
+
+### Framework versions
+
+- Transformers 4.37.0.dev0
+- Pytorch 2.1.2+cu121
+- Datasets 2.16.2.dev0
+- Tokenizers 0.15.0

generation_config.json

@@ -0,0 +1,14 @@
+{
+  "_from_model_config": true,
+  "begin_suppress_tokens": [
+    220,
+    50257
+  ],
+  "bos_token_id": 50257,
+  "decoder_start_token_id": 50258,
+  "eos_token_id": 50257,
+  "max_length": 448,
+  "pad_token_id": 50257,
+  "transformers_version": "4.37.0.dev0",
+  "use_cache": false
+}

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:bdb3046461227f302d6aaf4db61a9b294fb17d2ccff0e2c68716b7db5207e38f
+oid sha256:005702b9e7451377be8125b53827e08972b3445c56b65b8bd22ee5e57773d141
 size 966995080

runs/Feb22_09-47-02_ip-10-0-3-5.eu-west-1.compute.internal/events.out.tfevents.1708608172.ip-10-0-3-5.eu-west-1.compute.internal.12590.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:78fa177b3073a614cb21d43092281d4412c3a7da18ba875956fcdd3daa265573
-size 199109
+oid sha256:98b35903880be1063c4ccc616d70bdc9da59ed122b5f94e55ce34481c8642847
+size 201669

runs/Feb23_13-52-34_ip-10-0-3-5.eu-west-1.compute.internal/events.out.tfevents.1708696376.ip-10-0-3-5.eu-west-1.compute.internal.11543.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:56d8c1fc04aca9d3cb1fa228e59978c9756b7096cd3818c09646c80cb71da4f6
+size 5596

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9173ca736cbfd7f753a36a5a1db73cfb619e91806440f9ac506236640938ef64
+oid sha256:a2965ea4df87d49ffce12e6e9f87e02eacb88829ff09bc3c293387011423d2c8
 size 4920