Hugging Face's logo

shivanandmn
/
customer_care_dialog_summary

PEFT
TensorBoard
Safetensors
Generated from Trainer
Model card Files Metrics Community
shivanandmn commited on
Commit
2977b4b
•
1 Parent(s): 07be172

Model save

Browse files
Files changed (9) hide show
  1. README.md +7 -9
  2. adapter_config.json +3 -3
  3. adapter_model.safetensors +2 -2
  4. runs/Feb08_01-54-57_ecs-4a46/events.out.tfevents.1707342940.ecs-4a46.1691259.0 +3 -0
  5. runs/Feb10_17-12-14_sigmoid-pc/events.out.tfevents.1707565372.sigmoid-pc.140568.0 +3 -0
  6. runs/Feb10_17-30-41_sigmoid-pc/events.out.tfevents.1707566479.sigmoid-pc.157312.0 +3 -0
  7. runs/Feb10_17-39-37_sigmoid-pc/events.out.tfevents.1707567012.sigmoid-pc.165080.0 +3 -0
  8. runs/Feb10_17-41-48_sigmoid-pc/events.out.tfevents.1707567146.sigmoid-pc.167150.0 +3 -0
  9. training_args.bin +1 -1
README.md CHANGED
@@ -1,8 +1,6 @@
1
  ---
2
  library_name: peft
3
  tags:
4
- - trl
5
- - sft
6
  - generated_from_trainer
7
  base_model: meta-llama/Llama-2-7b-hf
8
  model-index:
@@ -17,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [meta-llama/Llama-2-7b-hf](https://huggingface.co/meta-llama/Llama-2-7b-hf) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 1.8164
21
 
22
  ## Model description
23
 
@@ -48,15 +46,15 @@ The following hyperparameters were used during training:
48
 
49
  | Training Loss | Epoch | Step | Validation Loss |
50
  |:-------------:|:-----:|:----:|:---------------:|
51
- | 1.7078 | 1.0 | 879 | 1.8323 |
52
- | 1.6217 | 2.0 | 1758 | 1.8208 |
53
- | 1.5842 | 3.0 | 2637 | 1.8164 |
54
 
55
 
56
  ### Framework versions
57
 
58
  - PEFT 0.7.1
59
- - Transformers 4.36.2
60
- - Pytorch 2.2.0+cu121
61
- - Datasets 2.16.1
62
  - Tokenizers 0.15.0
 
1
  ---
2
  library_name: peft
3
  tags:
 
 
4
  - generated_from_trainer
5
  base_model: meta-llama/Llama-2-7b-hf
6
  model-index:
 
15
 
16
  This model is a fine-tuned version of [meta-llama/Llama-2-7b-hf](https://huggingface.co/meta-llama/Llama-2-7b-hf) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 1.4256
19
 
20
  ## Model description
21
 
 
46
 
47
  | Training Loss | Epoch | Step | Validation Loss |
48
  |:-------------:|:-----:|:----:|:---------------:|
49
+ | 1.5304 | 1.0 | 879 | 1.4377 |
50
+ | 1.3424 | 2.0 | 1758 | 1.4293 |
51
+ | 1.2364 | 3.0 | 2637 | 1.4256 |
52
 
53
 
54
  ### Framework versions
55
 
56
  - PEFT 0.7.1
57
+ - Transformers 4.37.0.dev0
58
+ - Pytorch 2.1.0+cu121
59
+ - Datasets 2.14.6
60
  - Tokenizers 0.15.0
adapter_config.json CHANGED
@@ -15,12 +15,12 @@
15
  "megatron_core": "megatron.core",
16
  "modules_to_save": null,
17
  "peft_type": "LORA",
18
- "r": 16,
19
  "rank_pattern": {},
20
  "revision": null,
21
  "target_modules": [
22
- "v_proj",
23
- "q_proj"
24
  ],
25
  "task_type": "CAUSAL_LM"
26
  }
 
15
  "megatron_core": "megatron.core",
16
  "modules_to_save": null,
17
  "peft_type": "LORA",
18
+ "r": 4,
19
  "rank_pattern": {},
20
  "revision": null,
21
  "target_modules": [
22
+ "q_proj",
23
+ "v_proj"
24
  ],
25
  "task_type": "CAUSAL_LM"
26
  }
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:57add17527cd4ba5585c8ee45b325561d6c94c93c3d143bd4d61bbe6899a231d
3
- size 33571624
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dea4c0d920368ac39a3537cf90fce10b6cde53123c5d3e5d0763e73594da16f9
3
+ size 8405472
runs/Feb08_01-54-57_ecs-4a46/events.out.tfevents.1707342940.ecs-4a46.1691259.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a126b1d5c6a0e81d7140c20244880a3fae4e1f8cf432df1972d241d174a88d25
3
+ size 4504
runs/Feb10_17-12-14_sigmoid-pc/events.out.tfevents.1707565372.sigmoid-pc.140568.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:390369cfcb5a9623c3867d2e320c0fb8b39f244fc1f06cc405c3a687d11d78bd
3
+ size 4856
runs/Feb10_17-30-41_sigmoid-pc/events.out.tfevents.1707566479.sigmoid-pc.157312.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3b829160286256d4b71deb653f1dfe84ac19e80cb0f2727c3dd15d0f9a7a1034
3
+ size 4878
runs/Feb10_17-39-37_sigmoid-pc/events.out.tfevents.1707567012.sigmoid-pc.165080.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6096dba3bbab61ecf9cef348f2094cc03f76f2c2acf633e5a30f8ad330850d2f
3
+ size 4856
runs/Feb10_17-41-48_sigmoid-pc/events.out.tfevents.1707567146.sigmoid-pc.167150.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:23fc5def23734edff0b5355e81f063fa19b9815647cbd2d5ada6ddafa5c4d13e
3
+ size 6562
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c02f2e3cf4024c6ff500e9b077e925a4deb1ae3262bd85a26ada2cd354e7fb34
3
  size 4856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d810a794dca540b7ed45550efbf2f41c32e6def0f8e219dfab2d6f0d47b68c8
3
  size 4856