baotnguyen/ncis

README.md

@@ -14,13 +14,13 @@ model-index:
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
-[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/phdatdt/Fine%20tuning%20mistral%207B/runs/bcp8q4u5)
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/phdatdt/Fine%20tuning%20mistral%207B/runs/8lpu7o4v)
 # ncis
 
 This model is a fine-tuned version of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.5884
-- Accuracy: 0.8205
+- Loss: 0.8757
+- Accuracy: 0.9320
 
 ## Model description
 
@@ -51,16 +51,16 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|
-| No log        | 1.0   | 19   | 4.9428          | 0.4786   |
-| No log        | 2.0   | 38   | 4.6067          | 0.6325   |
-| No log        | 3.0   | 57   | 1.0003          | 0.8632   |
-| No log        | 4.0   | 76   | 1.4983          | 0.8376   |
-| No log        | 5.0   | 95   | 1.5749          | 0.8291   |
-| No log        | 6.0   | 114  | 1.5852          | 0.8205   |
-| No log        | 7.0   | 133  | 1.5872          | 0.8205   |
-| No log        | 8.0   | 152  | 1.5881          | 0.8205   |
-| No log        | 9.0   | 171  | 1.5883          | 0.8205   |
-| No log        | 10.0  | 190  | 1.5884          | 0.8205   |
+| No log        | 1.0   | 19   | 2.5491          | 0.6408   |
+| No log        | 2.0   | 38   | 6.8450          | 0.5922   |
+| No log        | 3.0   | 57   | 2.3423          | 0.7282   |
+| No log        | 4.0   | 76   | 3.2814          | 0.6990   |
+| No log        | 5.0   | 95   | 0.7817          | 0.9320   |
+| No log        | 6.0   | 114  | 0.8577          | 0.9320   |
+| No log        | 7.0   | 133  | 0.8714          | 0.9320   |
+| No log        | 8.0   | 152  | 0.8742          | 0.9320   |
+| No log        | 9.0   | 171  | 0.8755          | 0.9320   |
+| No log        | 10.0  | 190  | 0.8757          | 0.9320   |
 
 
 ### Framework versions

adapter_config.json

@@ -23,10 +23,10 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "v_proj",
-    "o_proj",
+    "q_proj",
     "k_proj",
-    "q_proj"
+    "v_proj",
+    "o_proj"
   ],
   "task_type": "SEQ_CLS",
   "use_dora": false,

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:50c94f9beb1061b5a465ffb22755c42d961992fe8be2c12a1d4abc7ff3875963
+oid sha256:c253fb165f8535efedc65fd218e2bc3c102348d4da1c6d3a19830dcf76f99bc6
 size 54593240

runs/Jul18_16-56-06_18d11760e5bd/events.out.tfevents.1721321767.18d11760e5bd.34.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6f26cf18014fcba36665aeab13b197afa14a2c1b910e51af886b9b67849a5589
+size 8865

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:16f01a08c55ecfc060eda800bf9f7dbc66243f103854aa02528a0df2e0578541
+oid sha256:05fcf0576de3b540acdcb4633e772b96b0a23c7efefd14169deb2a7d36c65bfa
 size 5112