dyang415 commited on
Commit
365d4a2
1 Parent(s): fde2602

End of training

Browse files
Files changed (2) hide show
  1. README.md +15 -1
  2. adapter_model.bin +1 -1
README.md CHANGED
@@ -2,6 +2,7 @@
2
  license: apache-2.0
3
  library_name: peft
4
  tags:
 
5
  - generated_from_trainer
6
  base_model: mistralai/Mistral-7B-Instruct-v0.2
7
  model-index:
@@ -92,7 +93,9 @@ fsdp_config:
92
 
93
  # nohto-v0-1e
94
 
95
- This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on an unknown dataset.
 
 
96
 
97
  ## Model description
98
 
@@ -125,6 +128,17 @@ The following hyperparameters were used during training:
125
  - lr_scheduler_warmup_steps: 10
126
  - num_epochs: 1
127
 
 
 
 
 
 
 
 
 
 
 
 
128
  ### Framework versions
129
 
130
  - PEFT 0.7.0
 
2
  license: apache-2.0
3
  library_name: peft
4
  tags:
5
+ - axolotl
6
  - generated_from_trainer
7
  base_model: mistralai/Mistral-7B-Instruct-v0.2
8
  model-index:
 
93
 
94
  # nohto-v0-1e
95
 
96
+ This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on the None dataset.
97
+ It achieves the following results on the evaluation set:
98
+ - Loss: 0.8883
99
 
100
  ## Model description
101
 
 
128
  - lr_scheduler_warmup_steps: 10
129
  - num_epochs: 1
130
 
131
+ ### Training results
132
+
133
+ | Training Loss | Epoch | Step | Validation Loss |
134
+ |:-------------:|:-----:|:----:|:---------------:|
135
+ | 1.7166 | 0.18 | 1 | 3.7658 |
136
+ | 2.1253 | 0.36 | 2 | 3.2472 |
137
+ | 2.1969 | 0.55 | 3 | 1.8100 |
138
+ | 1.0305 | 0.73 | 4 | 1.1527 |
139
+ | 0.7511 | 0.91 | 5 | 0.8883 |
140
+
141
+
142
  ### Framework versions
143
 
144
  - PEFT 0.7.0
adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:60f84692d7cce287b10d84ba4d054e226d82282f931e85864a0a39287b7607de
3
  size 102921869
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6cfb5e232ea4246531b6ee6fbfde9205ee86fc9a9468ced953286355065c237d
3
  size 102921869