azma-OpenHermes-2.5-Mistral-7B-agent-v1

README.md

@@ -17,6 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
 # results
 
 This model is a fine-tuned version of [teknium/OpenHermes-2.5-Mistral-7B](https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.6195
 
 ## Model description
 
@@ -44,12 +46,26 @@ The following hyperparameters were used during training:
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: cosine
 - lr_scheduler_warmup_ratio: 0.03
-- lr_scheduler_warmup_steps: 100
-- num_epochs: 0.5
+- lr_scheduler_warmup_steps: 50
+- num_epochs: 1
 - mixed_precision_training: Native AMP
 
 ### Training results
 
+| Training Loss | Epoch | Step | Validation Loss |
+|:-------------:|:-----:|:----:|:---------------:|
+| 0.9186        | 0.08  | 10   | 0.7712          |
+| 0.5375        | 0.15  | 20   | 0.6183          |
+| 0.5409        | 0.23  | 30   | 0.6055          |
+| 0.635         | 0.31  | 40   | 0.6214          |
+| 0.5464        | 0.39  | 50   | 0.6498          |
+| 0.5474        | 0.46  | 60   | 0.6732          |
+| 0.4542        | 0.54  | 70   | 0.6435          |
+| 0.5981        | 0.62  | 80   | 0.6585          |
+| 0.5791        | 0.7   | 90   | 0.6484          |
+| 0.4875        | 0.77  | 100  | 0.6360          |
+| 0.4654        | 0.85  | 110  | 0.6309          |
+| 0.4344        | 0.93  | 120  | 0.6195          |
 
 
 ### Framework versions

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f93929f78ffb16eff2842e26f71fb5fdebd1510414bb2a602415b72423301860
+oid sha256:3f53b8880175ceea3a441aa467da30ebb07bcb95be3e0052be313a2eddb8ba7e
 size 1216606552