ruggsea commited on
Commit
ff04447
1 Parent(s): ff2373e

Model save

Browse files
Files changed (1) hide show
  1. README.md +19 -1
README.md CHANGED
@@ -6,6 +6,8 @@ tags:
6
  - sft
7
  - generated_from_trainer
8
  base_model: meta-llama/Meta-Llama-3-8B-Instruct
 
 
9
  model-index:
10
  - name: Llama3-stanford-encyclopedia-philosophy-QA
11
  results: []
@@ -16,7 +18,9 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  # Llama3-stanford-encyclopedia-philosophy-QA
18
 
19
- This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) on an unknown dataset.
 
 
20
 
21
  ## Model description
22
 
@@ -46,6 +50,20 @@ The following hyperparameters were used during training:
46
  - lr_scheduler_warmup_ratio: 0.03
47
  - num_epochs: 3
48
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
49
  ### Framework versions
50
 
51
  - PEFT 0.10.0
 
6
  - sft
7
  - generated_from_trainer
8
  base_model: meta-llama/Meta-Llama-3-8B-Instruct
9
+ datasets:
10
+ - generator
11
  model-index:
12
  - name: Llama3-stanford-encyclopedia-philosophy-QA
13
  results: []
 
18
 
19
  # Llama3-stanford-encyclopedia-philosophy-QA
20
 
21
+ This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) on the generator dataset.
22
+ It achieves the following results on the evaluation set:
23
+ - Loss: 1.9202
24
 
25
  ## Model description
26
 
 
50
  - lr_scheduler_warmup_ratio: 0.03
51
  - num_epochs: 3
52
 
53
+ ### Training results
54
+
55
+ | Training Loss | Epoch | Step | Validation Loss |
56
+ |:-------------:|:------:|:----:|:---------------:|
57
+ | 1.9641 | 0.3529 | 15 | 1.9525 |
58
+ | 1.9096 | 0.7059 | 30 | 1.9184 |
59
+ | 1.8421 | 1.0588 | 45 | 1.9071 |
60
+ | 1.7913 | 1.4118 | 60 | 1.8996 |
61
+ | 1.7812 | 1.7647 | 75 | 1.8928 |
62
+ | 1.6468 | 2.1176 | 90 | 1.9158 |
63
+ | 1.5843 | 2.4706 | 105 | 1.9286 |
64
+ | 1.5829 | 2.8235 | 120 | 1.9202 |
65
+
66
+
67
  ### Framework versions
68
 
69
  - PEFT 0.10.0