strickvl
/

isafpr-mistral-lora-templatefree

Generated from Trainer

8-bit precision

Model card Files Files and versions Community

strickvl commited on Jun 15

Commit

b0fabfa

•

1 Parent(s): ceb784f

End of training

Files changed (2) hide show

README.md +17 -17
adapter_model.bin +1 -1

README.md CHANGED Viewed

@@ -110,7 +110,7 @@ special_tokens:
 This model is a fine-tuned version of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.0294
 ## Model description
@@ -148,22 +148,22 @@ The following hyperparameters were used during training:
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
 | 1.4053        | 0.0276 | 1    | 1.4080          |
-| 0.1886        | 0.2483 | 9    | 0.1361          |
-| 0.0544        | 0.4966 | 18   | 0.0546          |
-| 0.0524        | 0.7448 | 27   | 0.0445          |
-| 0.0392        | 0.9931 | 36   | 0.0395          |
-| 0.0356        | 1.2138 | 45   | 0.0369          |
-| 0.0396        | 1.4621 | 54   | 0.0350          |
-| 0.0281        | 1.7103 | 63   | 0.0341          |
-| 0.0334        | 1.9586 | 72   | 0.0330          |
-| 0.0257        | 2.1793 | 81   | 0.0316          |
-| 0.0204        | 2.4276 | 90   | 0.0313          |
-| 0.0264        | 2.6759 | 99   | 0.0309          |
-| 0.0239        | 2.9241 | 108  | 0.0298          |
-| 0.022         | 3.1517 | 117  | 0.0298          |
-| 0.0219        | 3.4    | 126  | 0.0296          |
-| 0.0221        | 3.6483 | 135  | 0.0295          |
-| 0.0205        | 3.8966 | 144  | 0.0294          |
 ### Framework versions

 This model is a fine-tuned version of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on the None dataset.
 It achieves the following results on the evaluation set:
+- Loss: 0.0297
 ## Model description
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
 | 1.4053        | 0.0276 | 1    | 1.4080          |
+| 0.1866        | 0.2483 | 9    | 0.1346          |
+| 0.0544        | 0.4966 | 18   | 0.0551          |
+| 0.0516        | 0.7448 | 27   | 0.0442          |
+| 0.0387        | 0.9931 | 36   | 0.0400          |
+| 0.0354        | 1.2138 | 45   | 0.0367          |
+| 0.0396        | 1.4621 | 54   | 0.0352          |
+| 0.0282        | 1.7103 | 63   | 0.0341          |
+| 0.0335        | 1.9586 | 72   | 0.0333          |
+| 0.0257        | 2.1793 | 81   | 0.0317          |
+| 0.0206        | 2.4276 | 90   | 0.0313          |
+| 0.0259        | 2.6759 | 99   | 0.0312          |
+| 0.024         | 2.9241 | 108  | 0.0301          |
+| 0.0219        | 3.1517 | 117  | 0.0300          |
+| 0.0221        | 3.4    | 126  | 0.0298          |
+| 0.0225        | 3.6483 | 135  | 0.0297          |
+| 0.0208        | 3.8966 | 144  | 0.0297          |
 ### Framework versions

adapter_model.bin CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b5113af9785be2ce52a1d2ed97d4327e878ed58b91cdaa70ed6a2a73e2a3afce
 size 335706186

 version https://git-lfs.github.com/spec/v1
+oid sha256:21129307a99244d1cb1aee7d135cf43959d8c94b86b4e62ff51ec7720e672542
 size 335706186