End of training

README.md

@@ -0,0 +1,68 @@
+---
+license: cc-by-4.0
+base_model: kxx-kkk/FYP_sq2_mrqa
+tags:
+- generated_from_trainer
+model-index:
+- name: FYP_sq2_mrqa_adqa
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# FYP_sq2_mrqa_adqa
+
+This model is a fine-tuned version of [kxx-kkk/FYP_sq2_mrqa](https://huggingface.co/kxx-kkk/FYP_sq2_mrqa) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 2.3786
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 1e-05
+- train_batch_size: 16
+- eval_batch_size: 16
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 3
+- mixed_precision_training: Native AMP
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss |
+|:-------------:|:-----:|:----:|:---------------:|
+| 3.508         | 0.27  | 500  | 2.6875          |
+| 3.3871        | 0.53  | 1000 | 2.6039          |
+| 3.3488        | 0.8   | 1500 | 2.5716          |
+| 3.3308        | 1.06  | 2000 | 2.4436          |
+| 3.2507        | 1.33  | 2500 | 2.4112          |
+| 3.2404        | 1.6   | 3000 | 2.3842          |
+| 3.242         | 1.86  | 3500 | 2.3779          |
+| 3.2038        | 2.13  | 4000 | 2.3941          |
+| 3.1811        | 2.4   | 4500 | 2.3838          |
+| 3.1818        | 2.66  | 5000 | 2.3892          |
+| 3.1721        | 2.93  | 5500 | 2.3786          |
+
+
+### Framework versions
+
+- Transformers 4.39.3
+- Pytorch 2.2.1+cu121
+- Datasets 2.18.0
+- Tokenizers 0.15.2

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c0d1387843abcc1b13ff3be0f1f49ceaa250c97c170846de8e24eff753c008ae
+oid sha256:472b0030adbb9604cfc20ed601de14352b185fcf54e4f7c8ef29bd16ed031559
 size 735356752

runs/Apr05_03-18-55_8502f778e629/events.out.tfevents.1712287136.8502f778e629.8219.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:345c2d60ae7ae3ae633051f88a5e77016eb670e18c4a99f79130e7d485604999
-size 10313
+oid sha256:a67eaf3a36b1cb0d661d86b88177c752423ee4399b7f82f289eee4687a811548
+size 10667