End of training
Browse files- README.md +12 -12
- adapter_config.json +1 -1
- adapter_model.safetensors +1 -1
- metrics.jsonl +2 -0
- metrics_epoch_0.96_fold_0_lr_0.001_seed_5678_weight_5.0.json +1 -0
- metrics_epoch_2.0_fold_0_lr_0.001_seed_5678_weight_5.0.json +1 -0
- results_epoch_0.96_fold_0_lr_0.001_seed_5678_weight_5.0.json +0 -0
- results_epoch_2.0_fold_0_lr_0.001_seed_5678_weight_5.0.json +0 -0
- training_args.bin +1 -1
README.md
CHANGED
@@ -18,13 +18,13 @@ should probably proofread and complete it, then remove this comment. -->
|
|
18 |
|
19 |
This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) on the None dataset.
|
20 |
It achieves the following results on the evaluation set:
|
21 |
-
- Loss:
|
22 |
-
- Eval/rewards/chosen:
|
23 |
-
- Eval/logps/chosen: -
|
24 |
-
- Eval/rewards/rejected:
|
25 |
-
- Eval/logps/rejected: -
|
26 |
-
- Eval/rewards/margins: 0.
|
27 |
-
- Eval/kl:
|
28 |
|
29 |
## Model description
|
30 |
|
@@ -43,7 +43,7 @@ More information needed
|
|
43 |
### Training hyperparameters
|
44 |
|
45 |
The following hyperparameters were used during training:
|
46 |
-
- learning_rate:
|
47 |
- train_batch_size: 1
|
48 |
- eval_batch_size: 2
|
49 |
- seed: 5678
|
@@ -56,10 +56,10 @@ The following hyperparameters were used during training:
|
|
56 |
|
57 |
### Training results
|
58 |
|
59 |
-
| Training Loss | Epoch | Step | Validation Loss |
|
60 |
-
|
61 |
-
| 0.
|
62 |
-
| 0.
|
63 |
|
64 |
|
65 |
### Framework versions
|
|
|
18 |
|
19 |
This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) on the None dataset.
|
20 |
It achieves the following results on the evaluation set:
|
21 |
+
- Loss: 1.4330
|
22 |
+
- Eval/rewards/chosen: 4.6256
|
23 |
+
- Eval/logps/chosen: -154.2737
|
24 |
+
- Eval/rewards/rejected: 5.4354
|
25 |
+
- Eval/logps/rejected: -185.9603
|
26 |
+
- Eval/rewards/margins: -0.8098
|
27 |
+
- Eval/kl: 49.4422
|
28 |
|
29 |
## Model description
|
30 |
|
|
|
43 |
### Training hyperparameters
|
44 |
|
45 |
The following hyperparameters were used during training:
|
46 |
+
- learning_rate: 0.001
|
47 |
- train_batch_size: 1
|
48 |
- eval_batch_size: 2
|
49 |
- seed: 5678
|
|
|
56 |
|
57 |
### Training results
|
58 |
|
59 |
+
| Training Loss | Epoch | Step | Validation Loss | |
|
60 |
+
|:-------------:|:-----:|:----:|:---------------:|:-------:|
|
61 |
+
| 0.5149 | 0.96 | 12 | 1.0695 | 24.8568 |
|
62 |
+
| 0.3612 | 2.0 | 25 | 1.4330 | 49.4422 |
|
63 |
|
64 |
|
65 |
### Framework versions
|
adapter_config.json
CHANGED
@@ -20,8 +20,8 @@
|
|
20 |
"rank_pattern": {},
|
21 |
"revision": null,
|
22 |
"target_modules": [
|
23 |
-
"q_proj",
|
24 |
"v_proj",
|
|
|
25 |
"o_proj",
|
26 |
"k_proj"
|
27 |
],
|
|
|
20 |
"rank_pattern": {},
|
21 |
"revision": null,
|
22 |
"target_modules": [
|
|
|
23 |
"v_proj",
|
24 |
+
"q_proj",
|
25 |
"o_proj",
|
26 |
"k_proj"
|
27 |
],
|
adapter_model.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 27297544
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f708c6475653e80d084a15f3bbe8ad032bf88214777a64a7cbfea2c71764e9ed
|
3 |
size 27297544
|
metrics.jsonl
CHANGED
@@ -16,3 +16,5 @@
|
|
16 |
{"epoch": 2.0, "precision": 0.9090909049586776, "recall": 0.6666666644444444, "fold": 0}
|
17 |
{"epoch": 0.96, "precision": 0.35897435851413545, "recall": 0.9333333302222222, "fold": 0}
|
18 |
{"epoch": 2.0, "precision": 0.3766233761342554, "recall": 0.9666666634444444, "fold": 0}
|
|
|
|
|
|
16 |
{"epoch": 2.0, "precision": 0.9090909049586776, "recall": 0.6666666644444444, "fold": 0}
|
17 |
{"epoch": 0.96, "precision": 0.35897435851413545, "recall": 0.9333333302222222, "fold": 0}
|
18 |
{"epoch": 2.0, "precision": 0.3766233761342554, "recall": 0.9666666634444444, "fold": 0}
|
19 |
+
{"epoch": 0.96, "precision": 0.4411764692906574, "recall": 0.4999999983333333, "fold": 0}
|
20 |
+
{"epoch": 2.0, "precision": 0.2238805968478503, "recall": 0.9999999966666666, "fold": 0}
|
metrics_epoch_0.96_fold_0_lr_0.001_seed_5678_weight_5.0.json
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
{"epoch": 0.96, "precision": 0.4411764692906574, "recall": 0.4999999983333333, "fold": 0}
|
metrics_epoch_2.0_fold_0_lr_0.001_seed_5678_weight_5.0.json
ADDED
@@ -0,0 +1 @@
|
|
|
|
|
1 |
+
{"epoch": 2.0, "precision": 0.2238805968478503, "recall": 0.9999999966666666, "fold": 0}
|
results_epoch_0.96_fold_0_lr_0.001_seed_5678_weight_5.0.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
results_epoch_2.0_fold_0_lr_0.001_seed_5678_weight_5.0.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
training_args.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 5688
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:00c4a5c0d0c7e1565c031b93a4e4b994ab226c5e0562f27245e0f51753f54206
|
3 |
size 5688
|