Hugging Face's logo

BaoTNguyen
/
ncis

PEFT
TensorBoard
Safetensors
Generated from Trainer
Model card Files Metrics Community
BaoTNguyen commited on
Commit
f4160ac
•
1 Parent(s): 317e34d

baotnguyen/ncis

Browse files
Files changed (5) hide show
  1. README.md +11 -8
  2. adapter_model.safetensors +1 -1
  3. runs/Jul22_19-23-09_90cc069fc707/events.out.tfevents.1721676190.90cc069fc707.34.14 +3 -0
  4. runs/Jul22_19-23-09_90cc069fc707/events.out.tfevents.1721677014.90cc069fc707.34.15 +3 -0
  5. training_args.bin +1 -1
README.md CHANGED
@@ -21,12 +21,13 @@ should probably proofread and complete it, then remove this comment. -->
21
  [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/phdatdt/Fine%20tuning%20mistral%207B/runs/4xqrob1d)
22
  [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/phdatdt/Fine%20tuning%20mistral%207B/runs/errke2dy)
23
  [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/phdatdt/Fine%20tuning%20mistral%207B/runs/ljcim1zv)
 
24
  # ncis
25
 
26
  This model is a fine-tuned version of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on the None dataset.
27
  It achieves the following results on the evaluation set:
28
- - Loss: 0.8589
29
- - Accuracy: 0.8205
30
 
31
  ## Model description
32
 
@@ -51,17 +52,19 @@ The following hyperparameters were used during training:
51
  - seed: 42
52
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
53
  - lr_scheduler_type: linear
54
- - num_epochs: 6
55
 
56
  ### Training results
57
 
58
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
59
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
60
- | 0.5641 | 1.0 | 19 | 1.7375 | 0.6496 |
61
- | 0.0034 | 2.0 | 38 | 0.8589 | 0.8205 |
62
- | 0.0 | 3.0 | 57 | 1.2763 | 0.7692 |
63
- | 0.0 | 4.0 | 76 | 1.3331 | 0.7692 |
64
- | 0.0 | 5.0 | 95 | 1.3380 | 0.7692 |
 
 
65
 
66
 
67
  ### Framework versions
 
21
  [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/phdatdt/Fine%20tuning%20mistral%207B/runs/4xqrob1d)
22
  [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/phdatdt/Fine%20tuning%20mistral%207B/runs/errke2dy)
23
  [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/phdatdt/Fine%20tuning%20mistral%207B/runs/ljcim1zv)
24
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/phdatdt/Fine%20tuning%20mistral%207B/runs/0115kz44)
25
  # ncis
26
 
27
  This model is a fine-tuned version of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on the None dataset.
28
  It achieves the following results on the evaluation set:
29
+ - Loss: 0.3313
30
+ - Accuracy: 0.9060
31
 
32
  ## Model description
33
 
 
52
  - seed: 42
53
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
54
  - lr_scheduler_type: linear
55
+ - num_epochs: 8
56
 
57
  ### Training results
58
 
59
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
60
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
61
+ | 0.7319 | 1.0 | 19 | 1.0418 | 0.7350 |
62
+ | 0.0004 | 2.0 | 38 | 0.9800 | 0.7350 |
63
+ | 0.0003 | 3.0 | 57 | 5.5397 | 0.4615 |
64
+ | 0.0387 | 4.0 | 76 | 0.3313 | 0.9060 |
65
+ | 0.0001 | 5.0 | 95 | 2.5728 | 0.6752 |
66
+ | 0.0 | 6.0 | 114 | 5.2674 | 0.4957 |
67
+ | 0.0 | 7.0 | 133 | 5.1163 | 0.4957 |
68
 
69
 
70
  ### Framework versions
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b7585b86fd9ab388962672fa7edfe491525ec813c7ebf0b8f26882dc9335187f
3
  size 54593240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:590b82bd03fd2f2926c95006569c87f9a9ffdd3ea62407653f04fb3d42e1c06d
3
  size 54593240
runs/Jul22_19-23-09_90cc069fc707/events.out.tfevents.1721676190.90cc069fc707.34.14 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d16aed6fdb0637364b317af680dc9aaeb92040a807a14f217c5a6bad08e06af
3
+ size 9551
runs/Jul22_19-23-09_90cc069fc707/events.out.tfevents.1721677014.90cc069fc707.34.15 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e446b6b302654d53c8f0411dc73490f4b8cad14573f999f1636825e6e8c7909c
3
+ size 411
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ffcb371fc1749a568224e775b91905372fedbc0aca04c489537e2de8f4a173cb
3
  size 5112
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2432b301b8be89eda557cbcdb47255b2e17fdc233f3479491e35f3508b8aeddf
3
  size 5112