End of training

README.md

@@ -21,11 +21,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [ntu-spml/distilhubert](https://huggingface.co/ntu-spml/distilhubert) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.0878
-- Accuracy: 0.9861
-- Precision: 0.9861
-- Recall: 0.9861
-- F1: 0.9861
+- Loss: 0.0359
+- Accuracy: 0.9883
+- Precision: 0.9883
+- Recall: 0.9883
+- F1: 0.9883
 
 ## Model description
 
@@ -44,7 +44,7 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 0.0001
+- learning_rate: 5e-05
 - train_batch_size: 8
 - eval_batch_size: 8
 - seed: 123
@@ -53,20 +53,19 @@ The following hyperparameters were used during training:
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: cosine
 - lr_scheduler_warmup_ratio: 0.001
-- num_epochs: 8
+- num_epochs: 10
 
 ### Training results
 
 | Training Loss | Epoch  | Step | Validation Loss | Accuracy | Precision | Recall | F1     |
 |:-------------:|:------:|:----:|:---------------:|:--------:|:---------:|:------:|:------:|
-| No log        | 0.9956 | 85   | 0.1204          | 0.9641   | 0.9641    | 0.9641 | 0.9638 |
-| No log        | 1.9912 | 170  | 0.0847          | 0.9773   | 0.9772    | 0.9773 | 0.9773 |
-| No log        | 2.9985 | 256  | 0.1025          | 0.9766   | 0.9769    | 0.9766 | 0.9766 |
-| No log        | 3.9941 | 341  | 0.0869          | 0.9832   | 0.9835    | 0.9832 | 0.9832 |
-| No log        | 4.9898 | 426  | 0.0746          | 0.9832   | 0.9834    | 0.9832 | 0.9832 |
-| 0.0538        | 5.9971 | 512  | 0.0870          | 0.9861   | 0.9861    | 0.9861 | 0.9861 |
-| 0.0538        | 6.9927 | 597  | 0.0890          | 0.9861   | 0.9861    | 0.9861 | 0.9861 |
-| 0.0538        | 7.9649 | 680  | 0.0878          | 0.9861   | 0.9861    | 0.9861 | 0.9861 |
+| No log        | 0.9956 | 85   | 0.1341          | 0.9538   | 0.9543    | 0.9538 | 0.9532 |
+| No log        | 1.9912 | 170  | 0.0831          | 0.9700   | 0.9720    | 0.9700 | 0.9703 |
+| No log        | 2.9985 | 256  | 0.0570          | 0.9846   | 0.9847    | 0.9846 | 0.9846 |
+| No log        | 3.9941 | 341  | 0.0340          | 0.9897   | 0.9898    | 0.9897 | 0.9898 |
+| No log        | 4.9898 | 426  | 0.0460          | 0.9875   | 0.9879    | 0.9875 | 0.9876 |
+| 0.0707        | 5.9971 | 512  | 0.0431          | 0.9897   | 0.9899    | 0.9897 | 0.9898 |
+| 0.0707        | 6.9927 | 597  | 0.0359          | 0.9883   | 0.9883    | 0.9883 | 0.9883 |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:dbc5b2463f7b10d6accd90a38663b1fe5924ce417d20bd4c4b022491ab407a53
+oid sha256:937ffa1cb79f16f4e7753ea842c3e32fe34e525562027e5b33ce48fc4b308a82
 size 94763496

runs/Sep08_20-15-47_ubumarcos/events.out.tfevents.1725819348.ubumarcos

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3acac0f35b9d995564af973913d52663295aac3c4883be89bc110f97f39bcd36
+size 9711

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:cda0bf828ccc04cd6d3fb7933f60f34ca3c8ba14b14579f9e878d688bc739b4a
+oid sha256:831297954221509dc3f32e8eaf01789c3f660cf430e186799d52e58ec3b5b334
 size 5240