victormiller commited on
Commit
7086c3b
1 Parent(s): 7533364

Upload validation loss - txt360 vs fineweb.csv

Browse files
data/validation loss - txt360 vs fineweb.csv ADDED
@@ -0,0 +1,58 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Step,FineWeb-1.5T,TxT360
2
+ 5000,2.911076784,2.589649677
3
+ 10000,2.75819993,2.438303471
4
+ 15000,2.647450924,2.383416414
5
+ 20000,2.588769436,2.337049007
6
+ 25000,2.565514088,2.300292492
7
+ 30000,2.527409077,2.29057312
8
+ 35000,2.506954193,2.285922527
9
+ 40000,2.493706465,2.265408278
10
+ 45000,2.478432178,2.245058537
11
+ 50000,2.476668596,2.24157238
12
+ 55000,2.467983723,2.23307991
13
+ 60000,2.4843328,2.232925415
14
+ 65000,2.439449787,2.226780653
15
+ 70000,2.438807011,2.222440243
16
+ 75000,2.426213741,2.194804668
17
+ 80000,2.459792614,2.210517406
18
+ 85000,2.426000357,2.186522722
19
+ 90000,2.403300762,2.185292006
20
+ 95000,2.399668455,2.184529305
21
+ 100000,2.404176235,2.185826778
22
+ 105000,2.39425993,2.171881914
23
+ 110000,2.406329632,2.182652235
24
+ 115000,2.381269455,2.169103146
25
+ 120000,2.387765169,2.162784815
26
+ 125000,2.373465776,2.165525436
27
+ 130000,2.374938488,2.159037828
28
+ 135000,2.379047394,2.164080143
29
+ 140000,2.370839834,2.143726826
30
+ 145000,2.351930141,2.144924164
31
+ 150000,2.35353899,2.138051987
32
+ 155000,2.356842279,2.138092995
33
+ 160000,2.343327522,2.120969057
34
+ 165000,2.335564375,
35
+ 170000,2.337301254,
36
+ 175000,2.322228193,
37
+ 180000,2.323165655,
38
+ 185000,2.309478998,
39
+ 190000,2.326301336,
40
+ 195000,2.314562321,
41
+ 200000,2.280953169,
42
+ 205000,2.291109324,
43
+ 210000,2.298957586,
44
+ 215000,2.282609463,
45
+ 220000,2.296112061,
46
+ 225000,2.286119938,
47
+ 230000,2.279724598,
48
+ 235000,2.268625498,
49
+ 240000,2.27303195,
50
+ 245000,2.254729986,
51
+ 250000,2.260175228,
52
+ 255000,2.248331785,
53
+ 260000,2.235989809,
54
+ 265000,2.241044521,
55
+ 270000,2.242579222,
56
+ 275000,2.216429472,
57
+ 280000,2.250077009,
58
+ 285000,2.224117756,