Hugging Face's logo

AugustGislerudRolfsen
/
fine-tuned-visionllama_6

PEFT
Safetensors
trl
sft
Generated from Trainer
Model card Files Community
AugustGislerudRolfsen commited on
Commit
4a4c5b5
•
1 Parent(s): 4b57cce

Model save

Browse files
Files changed (1) hide show
  1. README.md +116 -0
README.md CHANGED
@@ -18,6 +18,8 @@ should probably proofread and complete it, then remove this comment. -->
18
  # fine-tuned-visionllama_6
19
 
20
  This model is a fine-tuned version of [meta-llama/Llama-3.2-11B-Vision-Instruct](https://huggingface.co/meta-llama/Llama-3.2-11B-Vision-Instruct) on an unknown dataset.
 
 
21
 
22
  ## Model description
23
 
@@ -47,6 +49,120 @@ The following hyperparameters were used during training:
47
  - lr_scheduler_warmup_ratio: 0.03
48
  - num_epochs: 2
49
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
50
  ### Framework versions
51
 
52
  - PEFT 0.13.0
 
18
  # fine-tuned-visionllama_6
19
 
20
  This model is a fine-tuned version of [meta-llama/Llama-3.2-11B-Vision-Instruct](https://huggingface.co/meta-llama/Llama-3.2-11B-Vision-Instruct) on an unknown dataset.
21
+ It achieves the following results on the evaluation set:
22
+ - Loss: 2.0262
23
 
24
  ## Model description
25
 
 
49
  - lr_scheduler_warmup_ratio: 0.03
50
  - num_epochs: 2
51
 
52
+ ### Training results
53
+
54
+ | Training Loss | Epoch | Step | Validation Loss |
55
+ |:-------------:|:------:|:----:|:---------------:|
56
+ | 6.2195 | 0.0184 | 5 | 2.9157 |
57
+ | 2.5279 | 0.0368 | 10 | 2.3537 |
58
+ | 2.3247 | 0.0552 | 15 | 2.2259 |
59
+ | 2.237 | 0.0736 | 20 | 2.1789 |
60
+ | 2.1879 | 0.0920 | 25 | 2.1520 |
61
+ | 2.1381 | 0.1104 | 30 | 2.1353 |
62
+ | 2.1285 | 0.1288 | 35 | 2.1204 |
63
+ | 2.1076 | 0.1472 | 40 | 2.1085 |
64
+ | 2.0869 | 0.1657 | 45 | 2.1010 |
65
+ | 2.0694 | 0.1841 | 50 | 2.0966 |
66
+ | 2.0917 | 0.2025 | 55 | 2.0899 |
67
+ | 2.0597 | 0.2209 | 60 | 2.0858 |
68
+ | 2.05 | 0.2393 | 65 | 2.0810 |
69
+ | 2.0764 | 0.2577 | 70 | 2.0784 |
70
+ | 2.0872 | 0.2761 | 75 | 2.0763 |
71
+ | 2.0388 | 0.2945 | 80 | 2.0734 |
72
+ | 2.057 | 0.3129 | 85 | 2.0704 |
73
+ | 2.0423 | 0.3313 | 90 | 2.0667 |
74
+ | 2.022 | 0.3497 | 95 | 2.0647 |
75
+ | 2.0281 | 0.3681 | 100 | 2.0631 |
76
+ | 2.0407 | 0.3865 | 105 | 2.0638 |
77
+ | 2.0284 | 0.4049 | 110 | 2.0617 |
78
+ | 2.0311 | 0.4233 | 115 | 2.0597 |
79
+ | 2.0093 | 0.4417 | 120 | 2.0578 |
80
+ | 2.0191 | 0.4601 | 125 | 2.0543 |
81
+ | 2.0316 | 0.4785 | 130 | 2.0539 |
82
+ | 2.0243 | 0.4970 | 135 | 2.0526 |
83
+ | 1.9983 | 0.5154 | 140 | 2.0520 |
84
+ | 2.0298 | 0.5338 | 145 | 2.0530 |
85
+ | 2.0217 | 0.5522 | 150 | 2.0511 |
86
+ | 2.0115 | 0.5706 | 155 | 2.0488 |
87
+ | 1.9883 | 0.5890 | 160 | 2.0481 |
88
+ | 2.0207 | 0.6074 | 165 | 2.0462 |
89
+ | 2.0069 | 0.6258 | 170 | 2.0453 |
90
+ | 2.0045 | 0.6442 | 175 | 2.0432 |
91
+ | 2.0034 | 0.6626 | 180 | 2.0435 |
92
+ | 1.9921 | 0.6810 | 185 | 2.0426 |
93
+ | 1.9912 | 0.6994 | 190 | 2.0419 |
94
+ | 1.9969 | 0.7178 | 195 | 2.0403 |
95
+ | 2.0093 | 0.7362 | 200 | 2.0391 |
96
+ | 2.0154 | 0.7546 | 205 | 2.0389 |
97
+ | 1.9934 | 0.7730 | 210 | 2.0380 |
98
+ | 1.9926 | 0.7914 | 215 | 2.0354 |
99
+ | 1.9771 | 0.8098 | 220 | 2.0352 |
100
+ | 1.9819 | 0.8283 | 225 | 2.0330 |
101
+ | 1.9779 | 0.8467 | 230 | 2.0333 |
102
+ | 1.9846 | 0.8651 | 235 | 2.0340 |
103
+ | 1.9913 | 0.8835 | 240 | 2.0335 |
104
+ | 1.9834 | 0.9019 | 245 | 2.0319 |
105
+ | 1.9786 | 0.9203 | 250 | 2.0312 |
106
+ | 1.9726 | 0.9387 | 255 | 2.0306 |
107
+ | 1.9793 | 0.9571 | 260 | 2.0293 |
108
+ | 1.971 | 0.9755 | 265 | 2.0298 |
109
+ | 1.973 | 0.9939 | 270 | 2.0298 |
110
+ | 1.9651 | 1.0123 | 275 | 2.0307 |
111
+ | 1.9619 | 1.0307 | 280 | 2.0308 |
112
+ | 1.9536 | 1.0491 | 285 | 2.0320 |
113
+ | 1.9618 | 1.0675 | 290 | 2.0327 |
114
+ | 1.9555 | 1.0859 | 295 | 2.0307 |
115
+ | 1.9704 | 1.1043 | 300 | 2.0294 |
116
+ | 1.9609 | 1.1227 | 305 | 2.0290 |
117
+ | 1.9745 | 1.1411 | 310 | 2.0302 |
118
+ | 1.9707 | 1.1596 | 315 | 2.0268 |
119
+ | 1.9651 | 1.1780 | 320 | 2.0279 |
120
+ | 1.9745 | 1.1964 | 325 | 2.0276 |
121
+ | 1.9618 | 1.2148 | 330 | 2.0267 |
122
+ | 1.932 | 1.2332 | 335 | 2.0248 |
123
+ | 1.9495 | 1.2516 | 340 | 2.0258 |
124
+ | 1.9396 | 1.2700 | 345 | 2.0262 |
125
+ | 1.9277 | 1.2884 | 350 | 2.0264 |
126
+ | 1.9355 | 1.3068 | 355 | 2.0273 |
127
+ | 1.9502 | 1.3252 | 360 | 2.0273 |
128
+ | 1.9491 | 1.3436 | 365 | 2.0281 |
129
+ | 1.9489 | 1.3620 | 370 | 2.0274 |
130
+ | 1.9194 | 1.3804 | 375 | 2.0271 |
131
+ | 1.9179 | 1.3988 | 380 | 2.0258 |
132
+ | 1.9418 | 1.4172 | 385 | 2.0261 |
133
+ | 1.9618 | 1.4356 | 390 | 2.0269 |
134
+ | 1.9283 | 1.4540 | 395 | 2.0256 |
135
+ | 1.912 | 1.4724 | 400 | 2.0225 |
136
+ | 1.9284 | 1.4909 | 405 | 2.0230 |
137
+ | 1.9418 | 1.5093 | 410 | 2.0223 |
138
+ | 1.9245 | 1.5277 | 415 | 2.0241 |
139
+ | 1.9292 | 1.5461 | 420 | 2.0237 |
140
+ | 1.9442 | 1.5645 | 425 | 2.0241 |
141
+ | 1.9366 | 1.5829 | 430 | 2.0225 |
142
+ | 1.9318 | 1.6013 | 435 | 2.0233 |
143
+ | 1.9266 | 1.6197 | 440 | 2.0234 |
144
+ | 1.9211 | 1.6381 | 445 | 2.0218 |
145
+ | 1.9248 | 1.6565 | 450 | 2.0230 |
146
+ | 1.9476 | 1.6749 | 455 | 2.0227 |
147
+ | 1.9333 | 1.6933 | 460 | 2.0206 |
148
+ | 1.9193 | 1.7117 | 465 | 2.0196 |
149
+ | 1.9291 | 1.7301 | 470 | 2.0231 |
150
+ | 1.9009 | 1.7485 | 475 | 2.0223 |
151
+ | 1.9134 | 1.7669 | 480 | 2.0225 |
152
+ | 1.9337 | 1.7853 | 485 | 2.0200 |
153
+ | 1.9077 | 1.8038 | 490 | 2.0227 |
154
+ | 1.8962 | 1.8222 | 495 | 2.0227 |
155
+ | 1.9343 | 1.8406 | 500 | 2.0221 |
156
+ | 1.9307 | 1.8590 | 505 | 2.0237 |
157
+ | 1.9339 | 1.8774 | 510 | 2.0220 |
158
+ | 1.922 | 1.8958 | 515 | 2.0220 |
159
+ | 1.9289 | 1.9142 | 520 | 2.0220 |
160
+ | 1.9269 | 1.9326 | 525 | 2.0231 |
161
+ | 1.9149 | 1.9510 | 530 | 2.0216 |
162
+ | 1.8962 | 1.9694 | 535 | 2.0252 |
163
+ | 1.9568 | 1.9878 | 540 | 2.0262 |
164
+
165
+
166
  ### Framework versions
167
 
168
  - PEFT 0.13.0