Hugging Face's logo

kertob
/
content

PEFT
TensorBoard
Safetensors
trl
sft
Generated from Trainer
Model card Files Metrics Community
kertob commited on
Commit
bdedb3d
•
1 Parent(s): 44228d6

Training in progress, step 10

Browse files
Files changed (23) hide show
  1. adapter_config.json +1 -1
  2. adapter_model.safetensors +1 -1
  3. runs/Mar08_12-58-50_4997a2709b0f/events.out.tfevents.1709902731.4997a2709b0f.941.1 +3 -0
  4. runs/Mar08_13-01-52_4997a2709b0f/events.out.tfevents.1709902913.4997a2709b0f.24536.0 +3 -0
  5. tokenizer.json +1 -6
  6. training_args.bin +1 -1
  7. wandb/debug-cli.root.log +0 -0
  8. wandb/debug-internal.log +111 -554
  9. wandb/debug.log +29 -36
  10. wandb/run-20240308_121134-5y42ufcl/files/config.yaml +3 -3
  11. wandb/run-20240308_121134-5y42ufcl/files/output.log +31 -0
  12. wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json +1 -1
  13. wandb/run-20240308_121134-5y42ufcl/logs/debug-internal.log +0 -0
  14. wandb/run-20240308_121134-5y42ufcl/logs/debug.log +90 -0
  15. wandb/run-20240308_121134-5y42ufcl/run-5y42ufcl.wandb +0 -0
  16. wandb/run-20240308_130200-qomx2zsg/files/config.yaml +689 -0
  17. wandb/run-20240308_130200-qomx2zsg/files/output.log +1 -0
  18. wandb/run-20240308_130200-qomx2zsg/files/requirements.txt +499 -0
  19. wandb/run-20240308_130200-qomx2zsg/files/wandb-metadata.json +82 -0
  20. wandb/run-20240308_130200-qomx2zsg/files/wandb-summary.json +1 -0
  21. wandb/run-20240308_130200-qomx2zsg/logs/debug-internal.log +111 -0
  22. wandb/run-20240308_130200-qomx2zsg/logs/debug.log +30 -0
  23. wandb/run-20240308_130200-qomx2zsg/run-qomx2zsg.wandb +0 -0
adapter_config.json CHANGED
@@ -19,8 +19,8 @@
19
  "rank_pattern": {},
20
  "revision": null,
21
  "target_modules": [
22
- "dense_4h_to_h",
23
  "query_key_value",
 
24
  "dense",
25
  "dense_h_to_4h"
26
  ],
 
19
  "rank_pattern": {},
20
  "revision": null,
21
  "target_modules": [
 
22
  "query_key_value",
23
+ "dense_4h_to_h",
24
  "dense",
25
  "dense_h_to_4h"
26
  ],
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0d0dd9017fc54abfe4b85754e92530cc85993b404470a47d5da12e739b510a57
3
  size 261131840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:395c8dfa32f16e0fb0e9c83f70fc7bc9bf4d1d036050d6bacd8b762611f22c75
3
  size 261131840
runs/Mar08_12-58-50_4997a2709b0f/events.out.tfevents.1709902731.4997a2709b0f.941.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86ce1c5314f7406f3fb93fd4b706ff05069cc3e1e8ada1001c9e65f05492ef2f
3
+ size 4184
runs/Mar08_13-01-52_4997a2709b0f/events.out.tfevents.1709902913.4997a2709b0f.24536.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:222dc23fe211fea7a258f3c809e77a991c4de351761b46a87f28d7dc2a3292c5
3
+ size 5938
tokenizer.json CHANGED
@@ -1,11 +1,6 @@
1
  {
2
  "version": "1.0",
3
- "truncation": {
4
- "direction": "Right",
5
- "max_length": 128,
6
- "strategy": "LongestFirst",
7
- "stride": 0
8
- },
9
  "padding": null,
10
  "added_tokens": [
11
  {
 
1
  {
2
  "version": "1.0",
3
+ "truncation": null,
 
 
 
 
 
4
  "padding": null,
5
  "added_tokens": [
6
  {
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6482706a2800dd6a58da395be0aab73c3f6dd15f60c769856eaf06bfe25c6848
3
  size 4856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:34c71e61360943dc3ce787dc591d89eeed26c21820bbb7e1e7f5cb001110fa4a
3
  size 4856
wandb/debug-cli.root.log ADDED
File without changes
wandb/debug-internal.log CHANGED
@@ -1,554 +1,111 @@
1
- 2024-03-08 12:11:34,060 INFO StreamThr :10843 [internal.py:wandb_internal():86] W&B internal server running at pid: 10843, started at: 2024-03-08 12:11:34.060152
2
- 2024-03-08 12:11:34,062 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status
3
- 2024-03-08 12:11:39,065 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
4
- 2024-03-08 12:11:39,065 INFO WriterThread:10843 [datastore.py:open_for_write():87] open: /content/wandb/run-20240308_121134-5y42ufcl/run-5y42ufcl.wandb
5
- 2024-03-08 12:11:39,097 DEBUG SenderThread:10843 [sender.py:send():378] send: header
6
- 2024-03-08 12:11:39,101 DEBUG SenderThread:10843 [sender.py:send():378] send: run
7
- 2024-03-08 12:11:39,602 INFO SenderThread:10843 [dir_watcher.py:__init__():211] watching files in: /content/wandb/run-20240308_121134-5y42ufcl/files
8
- 2024-03-08 12:11:39,603 INFO SenderThread:10843 [sender.py:_start_run_threads():1099] run started: 5y42ufcl with start time 1709899894.060627
9
- 2024-03-08 12:11:39,606 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: check_version
10
- 2024-03-08 12:11:39,606 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: check_version
11
- 2024-03-08 12:11:39,749 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: run_start
12
- 2024-03-08 12:11:39,759 DEBUG HandlerThread:10843 [system_info.py:__init__():26] System info init
13
- 2024-03-08 12:11:39,759 DEBUG HandlerThread:10843 [system_info.py:__init__():41] System info init done
14
- 2024-03-08 12:11:39,759 INFO HandlerThread:10843 [system_monitor.py:start():194] Starting system monitor
15
- 2024-03-08 12:11:39,759 INFO SystemMonitor:10843 [system_monitor.py:_start():158] Starting system asset monitoring threads
16
- 2024-03-08 12:11:39,760 INFO HandlerThread:10843 [system_monitor.py:probe():214] Collecting system info
17
- 2024-03-08 12:11:39,760 INFO SystemMonitor:10843 [interfaces.py:start():190] Started cpu monitoring
18
- 2024-03-08 12:11:39,761 INFO SystemMonitor:10843 [interfaces.py:start():190] Started disk monitoring
19
- 2024-03-08 12:11:39,762 INFO SystemMonitor:10843 [interfaces.py:start():190] Started gpu monitoring
20
- 2024-03-08 12:11:39,762 INFO SystemMonitor:10843 [interfaces.py:start():190] Started memory monitoring
21
- 2024-03-08 12:11:39,763 INFO SystemMonitor:10843 [interfaces.py:start():190] Started network monitoring
22
- 2024-03-08 12:11:39,772 DEBUG HandlerThread:10843 [system_info.py:probe():150] Probing system
23
- 2024-03-08 12:11:39,773 DEBUG HandlerThread:10843 [gitlib.py:_init_repo():56] git repository is invalid
24
- 2024-03-08 12:11:39,773 DEBUG HandlerThread:10843 [system_info.py:probe():198] Probing system done
25
- 2024-03-08 12:11:39,773 DEBUG HandlerThread:10843 [system_monitor.py:probe():223] {'os': 'Linux-6.1.58+-x86_64-with-glibc2.35', 'python': '3.10.12', 'heartbeatAt': '2024-03-08T12:11:39.772379', 'startedAt': '2024-03-08T12:11:34.054080', 'docker': None, 'cuda': None, 'args': (), 'state': 'running', 'program': 'Smart_Agriculture_Falcon.ipynb', 'codePathLocal': None, 'colab': 'https://colab.research.google.com/notebook#fileId=1kv2VO7q0c8xX_DQt5NERLeJJZtHW6zHO', 'host': '4997a2709b0f', 'username': 'root', 'executable': '/usr/bin/python3', 'cpu_count': 4, 'cpu_count_logical': 8, 'cpu_freq': {'current': 2199.998, 'min': 0.0, 'max': 0.0}, 'cpu_freq_per_core': [{'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}], 'disk': {'/': {'total': 201.22513961791992, 'used': 52.550201416015625}}, 'gpu': 'Tesla T4', 'gpu_count': 1, 'gpu_devices': [{'name': 'Tesla T4', 'memory_total': 16106127360}], 'memory': {'total': 50.993690490722656}}
26
- 2024-03-08 12:11:39,774 INFO HandlerThread:10843 [system_monitor.py:probe():224] Finished collecting system info
27
- 2024-03-08 12:11:39,774 INFO HandlerThread:10843 [system_monitor.py:probe():227] Publishing system info
28
- 2024-03-08 12:11:39,774 INFO HandlerThread:10843 [system_monitor.py:probe():229] Finished publishing system info
29
- 2024-03-08 12:11:39,779 DEBUG SenderThread:10843 [sender.py:send():378] send: files
30
- 2024-03-08 12:11:39,780 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-metadata.json with policy now
31
- 2024-03-08 12:11:40,192 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: python_packages
32
- 2024-03-08 12:11:40,193 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: python_packages
33
- 2024-03-08 12:11:40,234 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
34
- 2024-03-08 12:11:40,234 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
35
- 2024-03-08 12:11:40,235 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
36
- 2024-03-08 12:11:40,523 INFO wandb-upload_0:10843 [upload_job.py:push():131] Uploaded file /tmp/tmprc6z1h8jwandb/bimoql9w-wandb-metadata.json
37
- 2024-03-08 12:11:40,532 DEBUG SenderThread:10843 [sender.py:send():378] send: telemetry
38
- 2024-03-08 12:11:40,532 DEBUG SenderThread:10843 [sender.py:send():378] send: config
39
- 2024-03-08 12:11:40,533 DEBUG SenderThread:10843 [sender.py:send():378] send: metric
40
- 2024-03-08 12:11:40,533 DEBUG SenderThread:10843 [sender.py:send():378] send: telemetry
41
- 2024-03-08 12:11:40,533 DEBUG SenderThread:10843 [sender.py:send():378] send: metric
42
- 2024-03-08 12:11:40,533 WARNING SenderThread:10843 [sender.py:send_metric():1316] Seen metric with glob (shouldn't happen)
43
- 2024-03-08 12:11:40,533 DEBUG SenderThread:10843 [sender.py:send():378] send: telemetry
44
- 2024-03-08 12:11:40,604 INFO Thread-12 :10843 [dir_watcher.py:_on_file_created():271] file/dir created: /content/wandb/run-20240308_121134-5y42ufcl/files/requirements.txt
45
- 2024-03-08 12:11:40,604 INFO Thread-12 :10843 [dir_watcher.py:_on_file_created():271] file/dir created: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-metadata.json
46
- 2024-03-08 12:11:44,534 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
47
- 2024-03-08 12:11:49,535 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
48
- 2024-03-08 12:11:54,536 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
49
- 2024-03-08 12:11:55,193 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
50
- 2024-03-08 12:11:55,194 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
51
- 2024-03-08 12:11:55,234 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
52
- 2024-03-08 12:12:00,453 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
53
- 2024-03-08 12:12:05,458 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
54
- 2024-03-08 12:12:06,612 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/config.yaml
55
- 2024-03-08 12:12:10,193 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
56
- 2024-03-08 12:12:10,194 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
57
- 2024-03-08 12:12:10,234 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
58
- 2024-03-08 12:12:11,477 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
59
- 2024-03-08 12:12:16,478 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
60
- 2024-03-08 12:12:21,479 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
61
- 2024-03-08 12:12:25,194 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
62
- 2024-03-08 12:12:25,194 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
63
- 2024-03-08 12:12:25,234 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
64
- 2024-03-08 12:12:27,400 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
65
- 2024-03-08 12:12:32,401 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
66
- 2024-03-08 12:12:37,402 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
67
- 2024-03-08 12:12:39,764 DEBUG SystemMonitor:10843 [system_monitor.py:_start():172] Starting system metrics aggregation loop
68
- 2024-03-08 12:12:39,765 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
69
- 2024-03-08 12:12:40,194 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
70
- 2024-03-08 12:12:40,194 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
71
- 2024-03-08 12:12:40,234 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
72
- 2024-03-08 12:12:42,416 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
73
- 2024-03-08 12:12:47,417 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
74
- 2024-03-08 12:12:52,417 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
75
- 2024-03-08 12:12:55,194 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
76
- 2024-03-08 12:12:55,194 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
77
- 2024-03-08 12:12:55,235 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
78
- 2024-03-08 12:12:57,445 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
79
- 2024-03-08 12:13:02,446 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
80
- 2024-03-08 12:13:07,447 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
81
- 2024-03-08 12:13:09,766 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
82
- 2024-03-08 12:13:10,194 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
83
- 2024-03-08 12:13:10,195 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
84
- 2024-03-08 12:13:10,235 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
85
- 2024-03-08 12:13:13,391 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
86
- 2024-03-08 12:13:18,392 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
87
- 2024-03-08 12:13:20,889 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: partial_history
88
- 2024-03-08 12:13:20,892 DEBUG SenderThread:10843 [sender.py:send():378] send: metric
89
- 2024-03-08 12:13:20,892 DEBUG SenderThread:10843 [sender.py:send():378] send: metric
90
- 2024-03-08 12:13:20,892 DEBUG SenderThread:10843 [sender.py:send():378] send: metric
91
- 2024-03-08 12:13:20,892 DEBUG SenderThread:10843 [sender.py:send():378] send: metric
92
- 2024-03-08 12:13:20,892 DEBUG SenderThread:10843 [sender.py:send():378] send: history
93
- 2024-03-08 12:13:20,892 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: summary_record
94
- 2024-03-08 12:13:20,894 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
95
- 2024-03-08 12:13:21,638 INFO Thread-12 :10843 [dir_watcher.py:_on_file_created():271] file/dir created: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json
96
- 2024-03-08 12:13:23,895 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
97
- 2024-03-08 12:13:25,194 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
98
- 2024-03-08 12:13:25,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
99
- 2024-03-08 12:13:25,195 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
100
- 2024-03-08 12:13:29,483 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
101
- 2024-03-08 12:13:34,484 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
102
- 2024-03-08 12:13:39,490 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
103
- 2024-03-08 12:13:39,798 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
104
- 2024-03-08 12:13:40,194 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
105
- 2024-03-08 12:13:40,195 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
106
- 2024-03-08 12:13:40,235 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
107
- 2024-03-08 12:13:40,645 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/config.yaml
108
- 2024-03-08 12:13:45,446 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
109
- 2024-03-08 12:13:50,446 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
110
- 2024-03-08 12:13:55,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
111
- 2024-03-08 12:13:55,195 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
112
- 2024-03-08 12:13:55,235 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
113
- 2024-03-08 12:13:55,464 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
114
- 2024-03-08 12:14:00,465 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
115
- 2024-03-08 12:14:05,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
116
- 2024-03-08 12:14:09,772 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
117
- 2024-03-08 12:14:10,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
118
- 2024-03-08 12:14:10,195 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
119
- 2024-03-08 12:14:10,235 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
120
- 2024-03-08 12:14:11,413 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
121
- 2024-03-08 12:14:16,414 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
122
- 2024-03-08 12:14:21,415 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
123
- 2024-03-08 12:14:25,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
124
- 2024-03-08 12:14:25,195 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
125
- 2024-03-08 12:14:25,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
126
- 2024-03-08 12:14:26,465 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
127
- 2024-03-08 12:14:31,466 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
128
- 2024-03-08 12:14:36,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
129
- 2024-03-08 12:14:39,773 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
130
- 2024-03-08 12:14:40,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
131
- 2024-03-08 12:14:40,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
132
- 2024-03-08 12:14:40,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
133
- 2024-03-08 12:14:42,466 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
134
- 2024-03-08 12:14:47,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
135
- 2024-03-08 12:14:52,468 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
136
- 2024-03-08 12:14:55,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
137
- 2024-03-08 12:14:55,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
138
- 2024-03-08 12:14:55,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
139
- 2024-03-08 12:14:58,403 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
140
- 2024-03-08 12:15:03,404 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
141
- 2024-03-08 12:15:08,405 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
142
- 2024-03-08 12:15:09,774 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
143
- 2024-03-08 12:15:10,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
144
- 2024-03-08 12:15:10,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
145
- 2024-03-08 12:15:10,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
146
- 2024-03-08 12:15:12,401 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: partial_history
147
- 2024-03-08 12:15:12,402 DEBUG SenderThread:10843 [sender.py:send():378] send: history
148
- 2024-03-08 12:15:12,403 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: summary_record
149
- 2024-03-08 12:15:12,403 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
150
- 2024-03-08 12:15:12,677 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json
151
- 2024-03-08 12:15:14,404 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
152
- 2024-03-08 12:15:19,405 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
153
- 2024-03-08 12:15:24,406 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
154
- 2024-03-08 12:15:25,195 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
155
- 2024-03-08 12:15:25,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
156
- 2024-03-08 12:15:25,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
157
- 2024-03-08 12:15:29,414 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
158
- 2024-03-08 12:15:34,415 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
159
- 2024-03-08 12:15:39,416 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
160
- 2024-03-08 12:15:39,775 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
161
- 2024-03-08 12:15:40,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
162
- 2024-03-08 12:15:40,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
163
- 2024-03-08 12:15:40,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
164
- 2024-03-08 12:15:44,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
165
- 2024-03-08 12:15:49,468 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
166
- 2024-03-08 12:15:54,470 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
167
- 2024-03-08 12:15:55,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
168
- 2024-03-08 12:15:55,196 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
169
- 2024-03-08 12:15:55,236 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
170
- 2024-03-08 12:16:00,453 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
171
- 2024-03-08 12:16:05,454 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
172
- 2024-03-08 12:16:09,775 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
173
- 2024-03-08 12:16:10,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
174
- 2024-03-08 12:16:10,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
175
- 2024-03-08 12:16:10,237 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
176
- 2024-03-08 12:16:11,398 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
177
- 2024-03-08 12:16:16,399 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
178
- 2024-03-08 12:16:21,400 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
179
- 2024-03-08 12:16:25,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
180
- 2024-03-08 12:16:25,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
181
- 2024-03-08 12:16:25,237 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
182
- 2024-03-08 12:16:26,495 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
183
- 2024-03-08 12:16:31,496 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
184
- 2024-03-08 12:16:36,497 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
185
- 2024-03-08 12:16:39,776 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
186
- 2024-03-08 12:16:40,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
187
- 2024-03-08 12:16:40,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
188
- 2024-03-08 12:16:40,237 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
189
- 2024-03-08 12:16:42,391 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
190
- 2024-03-08 12:16:47,391 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
191
- 2024-03-08 12:16:52,392 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
192
- 2024-03-08 12:16:55,196 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
193
- 2024-03-08 12:16:55,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
194
- 2024-03-08 12:16:55,237 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
195
- 2024-03-08 12:16:58,386 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
196
- 2024-03-08 12:17:03,387 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
197
- 2024-03-08 12:17:07,644 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: partial_history
198
- 2024-03-08 12:17:07,646 DEBUG SenderThread:10843 [sender.py:send():378] send: history
199
- 2024-03-08 12:17:07,646 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: summary_record
200
- 2024-03-08 12:17:07,646 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
201
- 2024-03-08 12:17:07,717 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json
202
- 2024-03-08 12:17:08,647 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
203
- 2024-03-08 12:17:09,777 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
204
- 2024-03-08 12:17:10,197 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
205
- 2024-03-08 12:17:10,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
206
- 2024-03-08 12:17:10,199 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
207
- 2024-03-08 12:17:14,437 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
208
- 2024-03-08 12:17:19,438 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
209
- 2024-03-08 12:17:24,439 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
210
- 2024-03-08 12:17:25,197 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
211
- 2024-03-08 12:17:25,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
212
- 2024-03-08 12:17:25,237 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
213
- 2024-03-08 12:17:30,410 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
214
- 2024-03-08 12:17:35,411 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
215
- 2024-03-08 12:17:39,778 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
216
- 2024-03-08 12:17:40,197 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
217
- 2024-03-08 12:17:40,197 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
218
- 2024-03-08 12:17:40,238 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
219
- 2024-03-08 12:17:40,468 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
220
- 2024-03-08 12:17:45,469 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
221
- 2024-03-08 12:17:50,471 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
222
- 2024-03-08 12:17:55,197 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
223
- 2024-03-08 12:17:55,198 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
224
- 2024-03-08 12:17:55,238 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
225
- 2024-03-08 12:17:56,387 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
226
- 2024-03-08 12:18:01,388 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
227
- 2024-03-08 12:18:06,389 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
228
- 2024-03-08 12:18:09,778 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
229
- 2024-03-08 12:18:10,197 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
230
- 2024-03-08 12:18:10,198 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
231
- 2024-03-08 12:18:10,238 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
232
- 2024-03-08 12:18:12,371 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
233
- 2024-03-08 12:18:17,373 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
234
- 2024-03-08 12:18:22,374 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
235
- 2024-03-08 12:18:25,197 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
236
- 2024-03-08 12:18:25,198 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
237
- 2024-03-08 12:18:25,239 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
238
- 2024-03-08 12:18:27,462 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
239
- 2024-03-08 12:18:32,463 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
240
- 2024-03-08 12:18:37,464 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
241
- 2024-03-08 12:18:39,779 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
242
- 2024-03-08 12:18:40,198 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
243
- 2024-03-08 12:18:40,198 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
244
- 2024-03-08 12:18:40,238 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
245
- 2024-03-08 12:18:43,460 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
246
- 2024-03-08 12:18:48,461 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
247
- 2024-03-08 12:18:53,462 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
248
- 2024-03-08 12:18:55,198 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
249
- 2024-03-08 12:18:55,198 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
250
- 2024-03-08 12:18:55,239 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
251
- 2024-03-08 12:18:59,462 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
252
- 2024-03-08 12:19:02,958 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: partial_history
253
- 2024-03-08 12:19:02,959 DEBUG SenderThread:10843 [sender.py:send():378] send: history
254
- 2024-03-08 12:19:02,959 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: summary_record
255
- 2024-03-08 12:19:02,960 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
256
- 2024-03-08 12:19:03,760 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json
257
- 2024-03-08 12:19:04,960 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
258
- 2024-03-08 12:19:09,780 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
259
- 2024-03-08 12:19:10,198 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
260
- 2024-03-08 12:19:10,199 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
261
- 2024-03-08 12:19:10,199 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
262
- 2024-03-08 12:19:10,454 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
263
- 2024-03-08 12:19:15,455 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
264
- 2024-03-08 12:19:20,456 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
265
- 2024-03-08 12:19:25,198 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
266
- 2024-03-08 12:19:25,199 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
267
- 2024-03-08 12:19:25,239 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
268
- 2024-03-08 12:19:26,397 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
269
- 2024-03-08 12:19:31,399 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
270
- 2024-03-08 12:19:36,399 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
271
- 2024-03-08 12:19:39,781 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
272
- 2024-03-08 12:19:40,199 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
273
- 2024-03-08 12:19:40,199 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
274
- 2024-03-08 12:19:40,239 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
275
- 2024-03-08 12:19:41,455 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
276
- 2024-03-08 12:19:46,455 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
277
- 2024-03-08 12:19:51,457 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
278
- 2024-03-08 12:19:55,199 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
279
- 2024-03-08 12:19:55,199 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
280
- 2024-03-08 12:19:55,239 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
281
- 2024-03-08 12:19:56,461 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
282
- 2024-03-08 12:20:01,462 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
283
- 2024-03-08 12:20:06,463 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
284
- 2024-03-08 12:20:09,781 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
285
- 2024-03-08 12:20:10,199 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
286
- 2024-03-08 12:20:10,199 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
287
- 2024-03-08 12:20:10,239 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
288
- 2024-03-08 12:20:12,431 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
289
- 2024-03-08 12:20:17,432 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
290
- 2024-03-08 12:20:22,433 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
291
- 2024-03-08 12:20:25,199 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
292
- 2024-03-08 12:20:25,199 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
293
- 2024-03-08 12:20:25,240 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
294
- 2024-03-08 12:20:27,471 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
295
- 2024-03-08 12:20:32,472 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
296
- 2024-03-08 12:20:37,473 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
297
- 2024-03-08 12:20:39,782 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
298
- 2024-03-08 12:20:40,199 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
299
- 2024-03-08 12:20:40,200 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
300
- 2024-03-08 12:20:40,240 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
301
- 2024-03-08 12:20:43,385 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
302
- 2024-03-08 12:20:48,386 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
303
- 2024-03-08 12:20:53,386 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
304
- 2024-03-08 12:20:55,199 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
305
- 2024-03-08 12:20:55,200 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
306
- 2024-03-08 12:20:55,240 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
307
- 2024-03-08 12:20:57,557 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: partial_history
308
- 2024-03-08 12:20:57,559 DEBUG SenderThread:10843 [sender.py:send():378] send: history
309
- 2024-03-08 12:20:57,559 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: summary_record
310
- 2024-03-08 12:20:57,560 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
311
- 2024-03-08 12:20:57,801 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json
312
- 2024-03-08 12:20:58,561 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
313
- 2024-03-08 12:21:03,562 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
314
- 2024-03-08 12:21:08,563 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
315
- 2024-03-08 12:21:09,782 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
316
- 2024-03-08 12:21:10,199 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
317
- 2024-03-08 12:21:10,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
318
- 2024-03-08 12:21:10,200 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
319
- 2024-03-08 12:21:14,467 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
320
- 2024-03-08 12:21:19,468 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
321
- 2024-03-08 12:21:24,469 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
322
- 2024-03-08 12:21:25,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
323
- 2024-03-08 12:21:25,200 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
324
- 2024-03-08 12:21:25,240 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
325
- 2024-03-08 12:21:30,388 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
326
- 2024-03-08 12:21:35,389 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
327
- 2024-03-08 12:21:39,783 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
328
- 2024-03-08 12:21:40,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
329
- 2024-03-08 12:21:40,200 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
330
- 2024-03-08 12:21:40,240 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
331
- 2024-03-08 12:21:40,489 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
332
- 2024-03-08 12:21:45,490 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
333
- 2024-03-08 12:21:50,491 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
334
- 2024-03-08 12:21:55,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
335
- 2024-03-08 12:21:55,200 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
336
- 2024-03-08 12:21:55,240 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
337
- 2024-03-08 12:21:56,408 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
338
- 2024-03-08 12:22:01,409 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
339
- 2024-03-08 12:22:06,410 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
340
- 2024-03-08 12:22:09,784 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
341
- 2024-03-08 12:22:10,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
342
- 2024-03-08 12:22:10,201 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
343
- 2024-03-08 12:22:10,241 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
344
- 2024-03-08 12:22:12,399 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
345
- 2024-03-08 12:22:17,400 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
346
- 2024-03-08 12:22:22,402 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
347
- 2024-03-08 12:22:25,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
348
- 2024-03-08 12:22:25,201 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
349
- 2024-03-08 12:22:25,241 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
350
- 2024-03-08 12:22:27,411 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
351
- 2024-03-08 12:22:32,413 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
352
- 2024-03-08 12:22:37,414 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
353
- 2024-03-08 12:22:39,785 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
354
- 2024-03-08 12:22:40,200 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
355
- 2024-03-08 12:22:40,201 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
356
- 2024-03-08 12:22:40,241 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
357
- 2024-03-08 12:22:42,463 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
358
- 2024-03-08 12:22:47,464 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
359
- 2024-03-08 12:22:52,161 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: partial_history
360
- 2024-03-08 12:22:52,162 DEBUG SenderThread:10843 [sender.py:send():378] send: history
361
- 2024-03-08 12:22:52,163 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: summary_record
362
- 2024-03-08 12:22:52,163 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
363
- 2024-03-08 12:22:52,839 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json
364
- 2024-03-08 12:22:53,164 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
365
- 2024-03-08 12:22:55,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
366
- 2024-03-08 12:22:55,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
367
- 2024-03-08 12:22:55,204 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
368
- 2024-03-08 12:22:58,461 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
369
- 2024-03-08 12:23:03,462 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
370
- 2024-03-08 12:23:08,463 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
371
- 2024-03-08 12:23:09,786 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
372
- 2024-03-08 12:23:10,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
373
- 2024-03-08 12:23:10,201 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
374
- 2024-03-08 12:23:10,241 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
375
- 2024-03-08 12:23:13,481 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
376
- 2024-03-08 12:23:18,482 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
377
- 2024-03-08 12:23:23,483 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
378
- 2024-03-08 12:23:25,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
379
- 2024-03-08 12:23:25,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
380
- 2024-03-08 12:23:25,242 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
381
- 2024-03-08 12:23:29,479 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
382
- 2024-03-08 12:23:34,480 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
383
- 2024-03-08 12:23:39,481 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
384
- 2024-03-08 12:23:39,786 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
385
- 2024-03-08 12:23:40,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
386
- 2024-03-08 12:23:40,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
387
- 2024-03-08 12:23:40,242 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
388
- 2024-03-08 12:23:45,391 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
389
- 2024-03-08 12:23:50,393 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
390
- 2024-03-08 12:23:55,201 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
391
- 2024-03-08 12:23:55,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
392
- 2024-03-08 12:23:55,242 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
393
- 2024-03-08 12:23:55,482 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
394
- 2024-03-08 12:24:00,483 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
395
- 2024-03-08 12:24:05,484 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
396
- 2024-03-08 12:24:09,787 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
397
- 2024-03-08 12:24:10,202 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
398
- 2024-03-08 12:24:10,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
399
- 2024-03-08 12:24:10,242 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
400
- 2024-03-08 12:24:11,458 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
401
- 2024-03-08 12:24:16,459 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
402
- 2024-03-08 12:24:21,460 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
403
- 2024-03-08 12:24:25,202 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
404
- 2024-03-08 12:24:25,202 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
405
- 2024-03-08 12:24:25,242 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
406
- 2024-03-08 12:24:27,387 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
407
- 2024-03-08 12:24:32,388 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
408
- 2024-03-08 12:24:37,390 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
409
- 2024-03-08 12:24:39,788 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
410
- 2024-03-08 12:24:40,202 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
411
- 2024-03-08 12:24:40,203 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
412
- 2024-03-08 12:24:40,243 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
413
- 2024-03-08 12:24:42,441 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
414
- 2024-03-08 12:24:46,078 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: partial_history
415
- 2024-03-08 12:24:46,079 DEBUG SenderThread:10843 [sender.py:send():378] send: history
416
- 2024-03-08 12:24:46,080 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: summary_record
417
- 2024-03-08 12:24:46,080 INFO SenderThread:10843 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
418
- 2024-03-08 12:24:46,879 INFO Thread-12 :10843 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json
419
- 2024-03-08 12:24:48,081 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
420
- 2024-03-08 12:24:53,082 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
421
- 2024-03-08 12:24:55,202 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
422
- 2024-03-08 12:24:55,203 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
423
- 2024-03-08 12:24:55,204 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
424
- 2024-03-08 12:24:58,475 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
425
- 2024-03-08 12:25:03,477 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
426
- 2024-03-08 12:25:08,478 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
427
- 2024-03-08 12:25:09,789 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
428
- 2024-03-08 12:25:10,203 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
429
- 2024-03-08 12:25:10,204 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
430
- 2024-03-08 12:25:10,244 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
431
- 2024-03-08 12:25:14,428 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
432
- 2024-03-08 12:25:19,429 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
433
- 2024-03-08 12:25:24,430 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
434
- 2024-03-08 12:25:25,203 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
435
- 2024-03-08 12:25:25,204 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
436
- 2024-03-08 12:25:25,245 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
437
- 2024-03-08 12:25:26,706 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: pause
438
- 2024-03-08 12:25:26,706 INFO HandlerThread:10843 [handler.py:handle_request_pause():708] stopping system metrics thread
439
- 2024-03-08 12:25:26,706 INFO HandlerThread:10843 [system_monitor.py:finish():203] Stopping system monitor
440
- 2024-03-08 12:25:26,707 INFO HandlerThread:10843 [interfaces.py:finish():202] Joined cpu monitor
441
- 2024-03-08 12:25:26,707 INFO HandlerThread:10843 [interfaces.py:finish():202] Joined disk monitor
442
- 2024-03-08 12:25:26,707 DEBUG SystemMonitor:10843 [system_monitor.py:_start():179] Finished system metrics aggregation loop
443
- 2024-03-08 12:25:26,708 DEBUG SystemMonitor:10843 [system_monitor.py:_start():183] Publishing last batch of metrics
444
- 2024-03-08 12:25:26,716 INFO HandlerThread:10843 [interfaces.py:finish():202] Joined gpu monitor
445
- 2024-03-08 12:25:26,716 INFO HandlerThread:10843 [interfaces.py:finish():202] Joined memory monitor
446
- 2024-03-08 12:25:26,716 INFO HandlerThread:10843 [interfaces.py:finish():202] Joined network monitor
447
- 2024-03-08 12:25:26,717 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
448
- 2024-03-08 12:25:29,718 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
449
- 2024-03-08 12:25:34,719 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
450
- 2024-03-08 12:25:39,720 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
451
- 2024-03-08 12:25:40,268 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
452
- 2024-03-08 12:25:40,268 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
453
- 2024-03-08 12:25:40,308 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
454
- 2024-03-08 12:25:42,794 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: resume
455
- 2024-03-08 12:25:42,794 INFO HandlerThread:10843 [handler.py:handle_request_resume():699] starting system metrics thread
456
- 2024-03-08 12:25:42,794 INFO HandlerThread:10843 [system_monitor.py:start():194] Starting system monitor
457
- 2024-03-08 12:25:42,794 INFO SystemMonitor:10843 [system_monitor.py:_start():158] Starting system asset monitoring threads
458
- 2024-03-08 12:25:42,794 INFO SystemMonitor:10843 [interfaces.py:start():190] Started cpu monitoring
459
- 2024-03-08 12:25:42,795 INFO SystemMonitor:10843 [interfaces.py:start():190] Started disk monitoring
460
- 2024-03-08 12:25:42,796 INFO SystemMonitor:10843 [interfaces.py:start():190] Started gpu monitoring
461
- 2024-03-08 12:25:42,796 INFO SystemMonitor:10843 [interfaces.py:start():190] Started memory monitoring
462
- 2024-03-08 12:25:42,797 INFO SystemMonitor:10843 [interfaces.py:start():190] Started network monitoring
463
- 2024-03-08 12:25:42,834 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: pause
464
- 2024-03-08 12:25:42,834 INFO HandlerThread:10843 [handler.py:handle_request_pause():708] stopping system metrics thread
465
- 2024-03-08 12:25:42,834 INFO HandlerThread:10843 [system_monitor.py:finish():203] Stopping system monitor
466
- 2024-03-08 12:25:42,834 INFO HandlerThread:10843 [interfaces.py:finish():202] Joined cpu monitor
467
- 2024-03-08 12:25:42,835 DEBUG SystemMonitor:10843 [system_monitor.py:_start():172] Starting system metrics aggregation loop
468
- 2024-03-08 12:25:42,835 DEBUG SystemMonitor:10843 [system_monitor.py:_start():179] Finished system metrics aggregation loop
469
- 2024-03-08 12:25:42,835 DEBUG SystemMonitor:10843 [system_monitor.py:_start():183] Publishing last batch of metrics
470
- 2024-03-08 12:25:42,836 INFO HandlerThread:10843 [interfaces.py:finish():202] Joined disk monitor
471
- 2024-03-08 12:25:42,841 INFO HandlerThread:10843 [interfaces.py:finish():202] Joined gpu monitor
472
- 2024-03-08 12:25:42,841 INFO HandlerThread:10843 [interfaces.py:finish():202] Joined memory monitor
473
- 2024-03-08 12:25:42,841 INFO HandlerThread:10843 [interfaces.py:finish():202] Joined network monitor
474
- 2024-03-08 12:25:42,842 DEBUG SenderThread:10843 [sender.py:send():378] send: stats
475
- 2024-03-08 12:25:44,843 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
476
- 2024-03-08 12:25:49,844 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
477
- 2024-03-08 12:25:54,845 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
478
- 2024-03-08 12:25:55,214 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
479
- 2024-03-08 12:25:55,214 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
480
- 2024-03-08 12:25:55,214 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
481
- 2024-03-08 12:26:00,485 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
482
- 2024-03-08 12:26:05,487 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
483
- 2024-03-08 12:26:10,214 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
484
- 2024-03-08 12:26:10,214 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
485
- 2024-03-08 12:26:10,214 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
486
- 2024-03-08 12:26:11,460 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
487
- 2024-03-08 12:26:16,461 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
488
- 2024-03-08 12:26:21,462 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
489
- 2024-03-08 12:26:25,214 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
490
- 2024-03-08 12:26:25,214 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
491
- 2024-03-08 12:26:25,215 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
492
- 2024-03-08 12:26:27,409 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
493
- 2024-03-08 12:26:32,411 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
494
- 2024-03-08 12:26:37,412 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
495
- 2024-03-08 12:26:40,214 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
496
- 2024-03-08 12:26:40,215 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
497
- 2024-03-08 12:26:40,215 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
498
- 2024-03-08 12:26:42,413 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
499
- 2024-03-08 12:26:47,414 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
500
- 2024-03-08 12:26:52,415 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
501
- 2024-03-08 12:26:55,214 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
502
- 2024-03-08 12:26:55,215 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
503
- 2024-03-08 12:26:55,215 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
504
- 2024-03-08 12:26:57,483 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
505
- 2024-03-08 12:27:02,485 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
506
- 2024-03-08 12:27:07,486 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
507
- 2024-03-08 12:27:10,215 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
508
- 2024-03-08 12:27:10,215 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
509
- 2024-03-08 12:27:10,215 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
510
- 2024-03-08 12:27:13,429 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
511
- 2024-03-08 12:27:18,431 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
512
- 2024-03-08 12:27:23,432 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
513
- 2024-03-08 12:27:25,215 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
514
- 2024-03-08 12:27:25,215 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
515
- 2024-03-08 12:27:25,215 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
516
- 2024-03-08 12:27:28,484 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
517
- 2024-03-08 12:27:33,485 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
518
- 2024-03-08 12:27:38,487 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
519
- 2024-03-08 12:27:40,215 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
520
- 2024-03-08 12:27:40,215 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
521
- 2024-03-08 12:27:40,216 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
522
- 2024-03-08 12:27:44,447 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
523
- 2024-03-08 12:27:49,449 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
524
- 2024-03-08 12:27:54,450 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
525
- 2024-03-08 12:27:55,215 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
526
- 2024-03-08 12:27:55,215 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
527
- 2024-03-08 12:27:55,216 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
528
- 2024-03-08 12:27:59,471 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
529
- 2024-03-08 12:28:04,472 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
530
- 2024-03-08 12:28:09,473 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
531
- 2024-03-08 12:28:10,215 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
532
- 2024-03-08 12:28:10,216 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
533
- 2024-03-08 12:28:10,216 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
534
- 2024-03-08 12:28:14,487 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
535
- 2024-03-08 12:28:19,488 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
536
- 2024-03-08 12:28:20,369 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: resume
537
- 2024-03-08 12:28:20,369 INFO HandlerThread:10843 [handler.py:handle_request_resume():699] starting system metrics thread
538
- 2024-03-08 12:28:20,369 INFO HandlerThread:10843 [system_monitor.py:start():194] Starting system monitor
539
- 2024-03-08 12:28:20,369 INFO SystemMonitor:10843 [system_monitor.py:_start():158] Starting system asset monitoring threads
540
- 2024-03-08 12:28:20,370 INFO SystemMonitor:10843 [interfaces.py:start():190] Started cpu monitoring
541
- 2024-03-08 12:28:20,371 INFO SystemMonitor:10843 [interfaces.py:start():190] Started disk monitoring
542
- 2024-03-08 12:28:20,372 INFO SystemMonitor:10843 [interfaces.py:start():190] Started gpu monitoring
543
- 2024-03-08 12:28:20,373 INFO SystemMonitor:10843 [interfaces.py:start():190] Started memory monitoring
544
- 2024-03-08 12:28:20,373 INFO SystemMonitor:10843 [interfaces.py:start():190] Started network monitoring
545
- 2024-03-08 12:28:24,489 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
546
- 2024-03-08 12:28:25,215 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
547
- 2024-03-08 12:28:25,216 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
548
- 2024-03-08 12:28:25,216 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
549
- 2024-03-08 12:28:30,418 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
550
- 2024-03-08 12:28:35,419 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
551
- 2024-03-08 12:28:40,215 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: internal_messages
552
- 2024-03-08 12:28:40,216 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: stop_status
553
- 2024-03-08 12:28:40,216 DEBUG SenderThread:10843 [sender.py:send_request():405] send_request: stop_status
554
- 2024-03-08 12:28:40,429 DEBUG HandlerThread:10843 [handler.py:handle_request():146] handle_request: status_report
 
1
+ 2024-03-08 13:02:00,787 INFO StreamThr :25394 [internal.py:wandb_internal():86] W&B internal server running at pid: 25394, started at: 2024-03-08 13:02:00.786482
2
+ 2024-03-08 13:02:00,788 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status
3
+ 2024-03-08 13:02:05,791 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
4
+ 2024-03-08 13:02:05,792 INFO WriterThread:25394 [datastore.py:open_for_write():87] open: /content/wandb/run-20240308_130200-qomx2zsg/run-qomx2zsg.wandb
5
+ 2024-03-08 13:02:05,817 DEBUG SenderThread:25394 [sender.py:send():378] send: header
6
+ 2024-03-08 13:02:05,820 DEBUG SenderThread:25394 [sender.py:send():378] send: run
7
+ 2024-03-08 13:02:06,337 INFO SenderThread:25394 [dir_watcher.py:__init__():211] watching files in: /content/wandb/run-20240308_130200-qomx2zsg/files
8
+ 2024-03-08 13:02:06,337 INFO SenderThread:25394 [sender.py:_start_run_threads():1099] run started: qomx2zsg with start time 1709902920.786651
9
+ 2024-03-08 13:02:06,339 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: check_version
10
+ 2024-03-08 13:02:06,339 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: check_version
11
+ 2024-03-08 13:02:06,567 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: run_start
12
+ 2024-03-08 13:02:06,578 DEBUG HandlerThread:25394 [system_info.py:__init__():26] System info init
13
+ 2024-03-08 13:02:06,578 DEBUG HandlerThread:25394 [system_info.py:__init__():41] System info init done
14
+ 2024-03-08 13:02:06,579 INFO HandlerThread:25394 [system_monitor.py:start():194] Starting system monitor
15
+ 2024-03-08 13:02:06,579 INFO SystemMonitor:25394 [system_monitor.py:_start():158] Starting system asset monitoring threads
16
+ 2024-03-08 13:02:06,579 INFO HandlerThread:25394 [system_monitor.py:probe():214] Collecting system info
17
+ 2024-03-08 13:02:06,580 INFO SystemMonitor:25394 [interfaces.py:start():190] Started cpu monitoring
18
+ 2024-03-08 13:02:06,580 INFO SystemMonitor:25394 [interfaces.py:start():190] Started disk monitoring
19
+ 2024-03-08 13:02:06,581 INFO SystemMonitor:25394 [interfaces.py:start():190] Started gpu monitoring
20
+ 2024-03-08 13:02:06,582 INFO SystemMonitor:25394 [interfaces.py:start():190] Started memory monitoring
21
+ 2024-03-08 13:02:06,583 INFO SystemMonitor:25394 [interfaces.py:start():190] Started network monitoring
22
+ 2024-03-08 13:02:06,589 DEBUG HandlerThread:25394 [system_info.py:probe():150] Probing system
23
+ 2024-03-08 13:02:06,590 DEBUG HandlerThread:25394 [gitlib.py:_init_repo():56] git repository is invalid
24
+ 2024-03-08 13:02:06,590 DEBUG HandlerThread:25394 [system_info.py:probe():198] Probing system done
25
+ 2024-03-08 13:02:06,590 DEBUG HandlerThread:25394 [system_monitor.py:probe():223] {'os': 'Linux-6.1.58+-x86_64-with-glibc2.35', 'python': '3.10.12', 'heartbeatAt': '2024-03-08T13:02:06.589080', 'startedAt': '2024-03-08T13:02:00.780539', 'docker': None, 'cuda': None, 'args': (), 'state': 'running', 'program': 'Smart_Agriculture_Falcon.ipynb', 'codePathLocal': None, 'colab': 'https://colab.research.google.com/notebook#fileId=1kv2VO7q0c8xX_DQt5NERLeJJZtHW6zHO', 'host': '4997a2709b0f', 'username': 'root', 'executable': '/usr/bin/python3', 'cpu_count': 4, 'cpu_count_logical': 8, 'cpu_freq': {'current': 2199.998, 'min': 0.0, 'max': 0.0}, 'cpu_freq_per_core': [{'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}], 'disk': {'/': {'total': 201.22513961791992, 'used': 58.329315185546875}}, 'gpu': 'Tesla T4', 'gpu_count': 1, 'gpu_devices': [{'name': 'Tesla T4', 'memory_total': 16106127360}], 'memory': {'total': 50.993690490722656}}
26
+ 2024-03-08 13:02:06,590 INFO HandlerThread:25394 [system_monitor.py:probe():224] Finished collecting system info
27
+ 2024-03-08 13:02:06,590 INFO HandlerThread:25394 [system_monitor.py:probe():227] Publishing system info
28
+ 2024-03-08 13:02:06,591 INFO HandlerThread:25394 [system_monitor.py:probe():229] Finished publishing system info
29
+ 2024-03-08 13:02:06,597 DEBUG SenderThread:25394 [sender.py:send():378] send: files
30
+ 2024-03-08 13:02:06,597 INFO SenderThread:25394 [sender.py:_save_file():1365] saving file wandb-metadata.json with policy now
31
+ 2024-03-08 13:02:07,304 INFO wandb-upload_0:25394 [upload_job.py:push():131] Uploaded file /tmp/tmpnr4g6anewandb/kyjo8nn9-wandb-metadata.json
32
+ 2024-03-08 13:02:07,339 INFO Thread-12 :25394 [dir_watcher.py:_on_file_created():271] file/dir created: /content/wandb/run-20240308_130200-qomx2zsg/files/wandb-metadata.json
33
+ 2024-03-08 13:02:07,428 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: python_packages
34
+ 2024-03-08 13:02:07,428 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: python_packages
35
+ 2024-03-08 13:02:07,468 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
36
+ 2024-03-08 13:02:07,468 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
37
+ 2024-03-08 13:02:07,469 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
38
+ 2024-03-08 13:02:07,708 DEBUG SenderThread:25394 [sender.py:send():378] send: telemetry
39
+ 2024-03-08 13:02:07,708 DEBUG SenderThread:25394 [sender.py:send():378] send: config
40
+ 2024-03-08 13:02:07,709 DEBUG SenderThread:25394 [sender.py:send():378] send: metric
41
+ 2024-03-08 13:02:07,709 DEBUG SenderThread:25394 [sender.py:send():378] send: telemetry
42
+ 2024-03-08 13:02:07,709 DEBUG SenderThread:25394 [sender.py:send():378] send: metric
43
+ 2024-03-08 13:02:07,709 WARNING SenderThread:25394 [sender.py:send_metric():1316] Seen metric with glob (shouldn't happen)
44
+ 2024-03-08 13:02:07,709 DEBUG SenderThread:25394 [sender.py:send():378] send: telemetry
45
+ 2024-03-08 13:02:08,338 INFO Thread-12 :25394 [dir_watcher.py:_on_file_created():271] file/dir created: /content/wandb/run-20240308_130200-qomx2zsg/files/requirements.txt
46
+ 2024-03-08 13:02:11,710 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
47
+ 2024-03-08 13:02:16,712 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
48
+ 2024-03-08 13:02:21,713 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
49
+ 2024-03-08 13:02:22,429 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
50
+ 2024-03-08 13:02:22,429 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
51
+ 2024-03-08 13:02:22,469 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
52
+ 2024-03-08 13:02:26,798 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
53
+ 2024-03-08 13:02:31,803 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
54
+ 2024-03-08 13:02:32,345 INFO Thread-12 :25394 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_130200-qomx2zsg/files/config.yaml
55
+ 2024-03-08 13:02:37,102 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
56
+ 2024-03-08 13:02:37,429 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
57
+ 2024-03-08 13:02:37,429 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
58
+ 2024-03-08 13:02:37,470 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
59
+ 2024-03-08 13:02:42,616 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
60
+ 2024-03-08 13:02:47,617 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
61
+ 2024-03-08 13:02:52,429 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
62
+ 2024-03-08 13:02:52,430 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
63
+ 2024-03-08 13:02:52,470 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
64
+ 2024-03-08 13:02:52,659 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
65
+ 2024-03-08 13:02:57,660 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
66
+ 2024-03-08 13:03:02,661 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
67
+ 2024-03-08 13:03:06,583 DEBUG SystemMonitor:25394 [system_monitor.py:_start():172] Starting system metrics aggregation loop
68
+ 2024-03-08 13:03:06,585 DEBUG SenderThread:25394 [sender.py:send():378] send: stats
69
+ 2024-03-08 13:03:07,430 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
70
+ 2024-03-08 13:03:07,430 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
71
+ 2024-03-08 13:03:07,470 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
72
+ 2024-03-08 13:03:07,718 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
73
+ 2024-03-08 13:03:12,719 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
74
+ 2024-03-08 13:03:17,720 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
75
+ 2024-03-08 13:03:22,430 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
76
+ 2024-03-08 13:03:22,430 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
77
+ 2024-03-08 13:03:22,470 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
78
+ 2024-03-08 13:03:23,640 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
79
+ 2024-03-08 13:03:28,641 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
80
+ 2024-03-08 13:03:33,642 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
81
+ 2024-03-08 13:03:36,586 DEBUG SenderThread:25394 [sender.py:send():378] send: stats
82
+ 2024-03-08 13:03:37,430 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
83
+ 2024-03-08 13:03:37,430 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
84
+ 2024-03-08 13:03:37,470 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
85
+ 2024-03-08 13:03:38,727 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
86
+ 2024-03-08 13:03:43,728 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
87
+ 2024-03-08 13:03:47,466 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: partial_history
88
+ 2024-03-08 13:03:47,468 DEBUG SenderThread:25394 [sender.py:send():378] send: metric
89
+ 2024-03-08 13:03:47,468 DEBUG SenderThread:25394 [sender.py:send():378] send: metric
90
+ 2024-03-08 13:03:47,468 DEBUG SenderThread:25394 [sender.py:send():378] send: metric
91
+ 2024-03-08 13:03:47,468 DEBUG SenderThread:25394 [sender.py:send():378] send: metric
92
+ 2024-03-08 13:03:47,469 DEBUG SenderThread:25394 [sender.py:send():378] send: history
93
+ 2024-03-08 13:03:47,469 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: summary_record
94
+ 2024-03-08 13:03:47,471 INFO SenderThread:25394 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
95
+ 2024-03-08 13:03:48,371 INFO Thread-12 :25394 [dir_watcher.py:_on_file_created():271] file/dir created: /content/wandb/run-20240308_130200-qomx2zsg/files/output.log
96
+ 2024-03-08 13:03:48,372 INFO Thread-12 :25394 [dir_watcher.py:_on_file_created():271] file/dir created: /content/wandb/run-20240308_130200-qomx2zsg/files/wandb-summary.json
97
+ 2024-03-08 13:03:49,507 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
98
+ 2024-03-08 13:03:50,372 INFO Thread-12 :25394 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_130200-qomx2zsg/files/output.log
99
+ 2024-03-08 13:03:52,430 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
100
+ 2024-03-08 13:03:52,430 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
101
+ 2024-03-08 13:03:52,431 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
102
+ 2024-03-08 13:03:54,676 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
103
+ 2024-03-08 13:03:59,677 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
104
+ 2024-03-08 13:04:04,683 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
105
+ 2024-03-08 13:04:05,378 INFO Thread-12 :25394 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_130200-qomx2zsg/files/config.yaml
106
+ 2024-03-08 13:04:06,586 DEBUG SenderThread:25394 [sender.py:send():378] send: stats
107
+ 2024-03-08 13:04:07,430 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
108
+ 2024-03-08 13:04:07,430 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
109
+ 2024-03-08 13:04:07,431 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
110
+ 2024-03-08 13:04:10,687 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
111
+ 2024-03-08 13:04:15,688 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
wandb/debug.log CHANGED
@@ -1,37 +1,30 @@
1
- 2024-03-08 12:11:34,055 INFO MainThread:941 [wandb_setup.py:_flush():76] Current SDK version is 0.16.4
2
- 2024-03-08 12:11:34,055 INFO MainThread:941 [wandb_setup.py:_flush():76] Configure stats pid to 941
3
- 2024-03-08 12:11:34,056 INFO MainThread:941 [wandb_setup.py:_flush():76] Loading settings from /root/.config/wandb/settings
4
- 2024-03-08 12:11:34,056 INFO MainThread:941 [wandb_setup.py:_flush():76] Loading settings from /content/wandb/settings
5
- 2024-03-08 12:11:34,056 INFO MainThread:941 [wandb_setup.py:_flush():76] Loading settings from environment variables: {}
6
- 2024-03-08 12:11:34,056 INFO MainThread:941 [wandb_setup.py:_flush():76] Applying setup settings: {'_disable_service': False}
7
- 2024-03-08 12:11:34,056 INFO MainThread:941 [wandb_setup.py:_flush():76] Inferring run settings from compute environment: {'program': '<python with no main file>'}
8
- 2024-03-08 12:11:34,056 INFO MainThread:941 [wandb_setup.py:_flush():76] Applying login settings: {'api_key': '***REDACTED***'}
9
- 2024-03-08 12:11:34,056 INFO MainThread:941 [wandb_init.py:_log_setup():526] Logging user logs to /content/wandb/run-20240308_121134-5y42ufcl/logs/debug.log
10
- 2024-03-08 12:11:34,056 INFO MainThread:941 [wandb_init.py:_log_setup():527] Logging internal logs to /content/wandb/run-20240308_121134-5y42ufcl/logs/debug-internal.log
11
- 2024-03-08 12:11:34,056 INFO MainThread:941 [wandb_init.py:_jupyter_setup():472] configuring jupyter hooks <wandb.sdk.wandb_init._WandbInit object at 0x79c5744eada0>
12
- 2024-03-08 12:11:34,057 INFO MainThread:941 [wandb_init.py:init():566] calling init triggers
13
- 2024-03-08 12:11:34,057 INFO MainThread:941 [wandb_init.py:init():573] wandb.init called with sweep_config: {}
14
  config: {}
15
- 2024-03-08 12:11:34,057 INFO MainThread:941 [wandb_init.py:init():616] starting backend
16
- 2024-03-08 12:11:34,057 INFO MainThread:941 [wandb_init.py:init():620] setting up manager
17
- 2024-03-08 12:11:34,058 INFO MainThread:941 [backend.py:_multiprocessing_setup():105] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
18
- 2024-03-08 12:11:34,060 INFO MainThread:941 [wandb_init.py:init():628] backend started and connected
19
- 2024-03-08 12:11:34,071 INFO MainThread:941 [wandb_run.py:_label_probe_notebook():1295] probe notebook
20
- 2024-03-08 12:11:39,096 INFO MainThread:941 [wandb_run.py:_label_probe_notebook():1305] Unable to probe notebook: 'NoneType' object has no attribute 'get'
21
- 2024-03-08 12:11:39,096 INFO MainThread:941 [wandb_init.py:init():720] updated telemetry
22
- 2024-03-08 12:11:39,100 INFO MainThread:941 [wandb_init.py:init():753] communicating run to backend with 90.0 second timeout
23
- 2024-03-08 12:11:39,605 INFO MainThread:941 [wandb_run.py:_on_init():2262] communicating current version
24
- 2024-03-08 12:11:39,744 INFO MainThread:941 [wandb_run.py:_on_init():2271] got version response
25
- 2024-03-08 12:11:39,744 INFO MainThread:941 [wandb_init.py:init():804] starting run threads in backend
26
- 2024-03-08 12:11:40,193 INFO MainThread:941 [wandb_run.py:_console_start():2241] atexit reg
27
- 2024-03-08 12:11:40,194 INFO MainThread:941 [wandb_run.py:_redirect():2096] redirect: wrap_raw
28
- 2024-03-08 12:11:40,194 INFO MainThread:941 [wandb_run.py:_redirect():2161] Wrapping output streams.
29
- 2024-03-08 12:11:40,194 INFO MainThread:941 [wandb_run.py:_redirect():2186] Redirects installed.
30
- 2024-03-08 12:11:40,195 INFO MainThread:941 [wandb_init.py:init():847] run started, returning control to user process
31
- 2024-03-08 12:11:40,202 INFO MainThread:941 [wandb_run.py:_config_callback():1343] config_cb None None {'vocab_size': 65024, 'hidden_size': 4544, 'num_hidden_layers': 32, 'num_attention_heads': 71, 'layer_norm_epsilon': 1e-05, 'initializer_range': 0.02, 'use_cache': False, 'hidden_dropout': 0.0, 'attention_dropout': 0.0, 'bos_token_id': 11, 'eos_token_id': 11, 'num_kv_heads': 71, 'alibi': False, 'new_decoder_architecture': False, 'multi_query': True, 'parallel_attn': True, 'bias': False, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'bfloat16', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['FalconForCausalLM'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'pad_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'vilsonrodrigues/falcon-7b-instruct-sharded', 'transformers_version': '4.38.2', 'apply_residual_connection_post_layernorm': False, 'auto_map': {'AutoConfig': 'vilsonrodrigues/falcon-7b-instruct-sharded--configuration_falcon.FalconConfig', 'AutoModel': 'vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconModel', 'AutoModelForSequenceClassification': 'vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconForSequenceClassification', 'AutoModelForTokenClassification': 'vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconForTokenClassification', 'AutoModelForQuestionAnswering': 'vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconForQuestionAnswering', 'AutoModelForCausalLM': 'vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconForCausalLM'}, 'model_type': 'falcon', 'quantization_config': {'quant_method': 'QuantizationMethod.BITS_AND_BYTES', '_load_in_8bit': False, '_load_in_4bit': True, 'llm_int8_threshold': 6.0, 'llm_int8_skip_modules': None, 'llm_int8_enable_fp32_cpu_offload': False, 'llm_int8_has_fp16_weight': False, 'bnb_4bit_quant_type': 'nf4', 'bnb_4bit_use_double_quant': True, 'bnb_4bit_compute_dtype': 'float16', 'load_in_4bit': True, 'load_in_8bit': False}, 'output_dir': './', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': False, 'do_predict': False, 'evaluation_strategy': 'no', 'prediction_loss_only': False, 'per_device_train_batch_size': 4, 'per_device_eval_batch_size': 8, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 4, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 0.0002, 'weight_decay': 0.0, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 0.3, 'num_train_epochs': 3.0, 'max_steps': 250, 'lr_scheduler_type': 'cosine', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.03, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': './runs/Mar08_12-04-48_4997a2709b0f', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 10, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 10, 'save_total_limit': None, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': True, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'dataloader_prefetch_factor': None, 'past_index': -1, 'run_name': './', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': False, 'metric_for_best_model': None, 'greater_is_better': None, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'accelerator_config': {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True}, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'paged_adamw_32bit', 'optim_args': None, 'adafactor': False, 'group_by_length': True, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'fp16_backend': 'auto', 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': None, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None}
32
- 2024-03-08 12:25:26,705 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
33
- 2024-03-08 12:25:26,705 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
34
- 2024-03-08 12:25:42,793 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
35
- 2024-03-08 12:25:42,797 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
36
- 2024-03-08 12:25:42,797 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
37
- 2024-03-08 12:28:20,368 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
 
1
+ 2024-03-08 13:02:00,782 INFO MainThread:24536 [wandb_setup.py:_flush():76] Current SDK version is 0.16.4
2
+ 2024-03-08 13:02:00,782 INFO MainThread:24536 [wandb_setup.py:_flush():76] Configure stats pid to 24536
3
+ 2024-03-08 13:02:00,782 INFO MainThread:24536 [wandb_setup.py:_flush():76] Loading settings from /root/.config/wandb/settings
4
+ 2024-03-08 13:02:00,782 INFO MainThread:24536 [wandb_setup.py:_flush():76] Loading settings from /content/wandb/settings
5
+ 2024-03-08 13:02:00,782 INFO MainThread:24536 [wandb_setup.py:_flush():76] Loading settings from environment variables: {}
6
+ 2024-03-08 13:02:00,782 INFO MainThread:24536 [wandb_setup.py:_flush():76] Applying setup settings: {'_disable_service': False}
7
+ 2024-03-08 13:02:00,782 INFO MainThread:24536 [wandb_setup.py:_flush():76] Inferring run settings from compute environment: {'program': '<python with no main file>'}
8
+ 2024-03-08 13:02:00,782 INFO MainThread:24536 [wandb_init.py:_log_setup():526] Logging user logs to /content/wandb/run-20240308_130200-qomx2zsg/logs/debug.log
9
+ 2024-03-08 13:02:00,782 INFO MainThread:24536 [wandb_init.py:_log_setup():527] Logging internal logs to /content/wandb/run-20240308_130200-qomx2zsg/logs/debug-internal.log
10
+ 2024-03-08 13:02:00,782 INFO MainThread:24536 [wandb_init.py:_jupyter_setup():472] configuring jupyter hooks <wandb.sdk.wandb_init._WandbInit object at 0x7a424cd9a800>
11
+ 2024-03-08 13:02:00,783 INFO MainThread:24536 [wandb_init.py:init():566] calling init triggers
12
+ 2024-03-08 13:02:00,783 INFO MainThread:24536 [wandb_init.py:init():573] wandb.init called with sweep_config: {}
 
13
  config: {}
14
+ 2024-03-08 13:02:00,783 INFO MainThread:24536 [wandb_init.py:init():616] starting backend
15
+ 2024-03-08 13:02:00,783 INFO MainThread:24536 [wandb_init.py:init():620] setting up manager
16
+ 2024-03-08 13:02:00,785 INFO MainThread:24536 [backend.py:_multiprocessing_setup():105] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
17
+ 2024-03-08 13:02:00,786 INFO MainThread:24536 [wandb_init.py:init():628] backend started and connected
18
+ 2024-03-08 13:02:00,798 INFO MainThread:24536 [wandb_run.py:_label_probe_notebook():1295] probe notebook
19
+ 2024-03-08 13:02:05,815 INFO MainThread:24536 [wandb_run.py:_label_probe_notebook():1305] Unable to probe notebook: 'NoneType' object has no attribute 'get'
20
+ 2024-03-08 13:02:05,815 INFO MainThread:24536 [wandb_init.py:init():720] updated telemetry
21
+ 2024-03-08 13:02:05,819 INFO MainThread:24536 [wandb_init.py:init():753] communicating run to backend with 90.0 second timeout
22
+ 2024-03-08 13:02:06,338 INFO MainThread:24536 [wandb_run.py:_on_init():2262] communicating current version
23
+ 2024-03-08 13:02:06,561 INFO MainThread:24536 [wandb_run.py:_on_init():2271] got version response
24
+ 2024-03-08 13:02:06,561 INFO MainThread:24536 [wandb_init.py:init():804] starting run threads in backend
25
+ 2024-03-08 13:02:07,429 INFO MainThread:24536 [wandb_run.py:_console_start():2241] atexit reg
26
+ 2024-03-08 13:02:07,429 INFO MainThread:24536 [wandb_run.py:_redirect():2096] redirect: wrap_raw
27
+ 2024-03-08 13:02:07,429 INFO MainThread:24536 [wandb_run.py:_redirect():2161] Wrapping output streams.
28
+ 2024-03-08 13:02:07,429 INFO MainThread:24536 [wandb_run.py:_redirect():2186] Redirects installed.
29
+ 2024-03-08 13:02:07,430 INFO MainThread:24536 [wandb_init.py:init():847] run started, returning control to user process
30
+ 2024-03-08 13:02:07,434 INFO MainThread:24536 [wandb_run.py:_config_callback():1343] config_cb None None {'vocab_size': 65024, 'hidden_size': 4544, 'num_hidden_layers': 32, 'num_attention_heads': 71, 'layer_norm_epsilon': 1e-05, 'initializer_range': 0.02, 'use_cache': False, 'hidden_dropout': 0.0, 'attention_dropout': 0.0, 'bos_token_id': 11, 'eos_token_id': 11, 'num_kv_heads': 71, 'alibi': False, 'new_decoder_architecture': False, 'multi_query': True, 'parallel_attn': True, 'bias': False, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'bfloat16', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['FalconForCausalLM'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'pad_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'vilsonrodrigues/falcon-7b-instruct-sharded', 'transformers_version': '4.38.2', 'apply_residual_connection_post_layernorm': False, 'auto_map': {'AutoConfig': 'vilsonrodrigues/falcon-7b-instruct-sharded--configuration_falcon.FalconConfig', 'AutoModel': 'vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconModel', 'AutoModelForSequenceClassification': 'vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconForSequenceClassification', 'AutoModelForTokenClassification': 'vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconForTokenClassification', 'AutoModelForQuestionAnswering': 'vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconForQuestionAnswering', 'AutoModelForCausalLM': 'vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconForCausalLM'}, 'model_type': 'falcon', 'quantization_config': {'quant_method': 'QuantizationMethod.BITS_AND_BYTES', '_load_in_8bit': False, '_load_in_4bit': True, 'llm_int8_threshold': 6.0, 'llm_int8_skip_modules': None, 'llm_int8_enable_fp32_cpu_offload': False, 'llm_int8_has_fp16_weight': False, 'bnb_4bit_quant_type': 'nf4', 'bnb_4bit_use_double_quant': True, 'bnb_4bit_compute_dtype': 'float16', 'load_in_4bit': True, 'load_in_8bit': False}, 'output_dir': './', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': False, 'do_predict': False, 'evaluation_strategy': 'no', 'prediction_loss_only': False, 'per_device_train_batch_size': 4, 'per_device_eval_batch_size': 8, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 4, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 0.0001, 'weight_decay': 0.0, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 0.3, 'num_train_epochs': 3.0, 'max_steps': 30, 'lr_scheduler_type': 'cosine', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.03, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': './runs/Mar08_13-01-52_4997a2709b0f', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 10, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 10, 'save_total_limit': None, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': True, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'dataloader_prefetch_factor': None, 'past_index': -1, 'run_name': './', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': False, 'metric_for_best_model': None, 'greater_is_better': None, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'accelerator_config': {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True}, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'paged_adamw_32bit', 'optim_args': None, 'adafactor': False, 'group_by_length': True, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'fp16_backend': 'auto', 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': None, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None}
 
 
 
 
 
 
wandb/run-20240308_121134-5y42ufcl/files/config.yaml CHANGED
@@ -361,7 +361,7 @@ eval_delay:
361
  value: 0
362
  learning_rate:
363
  desc: null
364
- value: 0.0002
365
  weight_decay:
366
  desc: null
367
  value: 0.0
@@ -382,7 +382,7 @@ num_train_epochs:
382
  value: 3.0
383
  max_steps:
384
  desc: null
385
- value: 250
386
  lr_scheduler_type:
387
  desc: null
388
  value: cosine
@@ -406,7 +406,7 @@ log_on_each_node:
406
  value: true
407
  logging_dir:
408
  desc: null
409
- value: ./runs/Mar08_12-04-48_4997a2709b0f
410
  logging_strategy:
411
  desc: null
412
  value: steps
 
361
  value: 0
362
  learning_rate:
363
  desc: null
364
+ value: 0.0001
365
  weight_decay:
366
  desc: null
367
  value: 0.0
 
382
  value: 3.0
383
  max_steps:
384
  desc: null
385
+ value: 30
386
  lr_scheduler_type:
387
  desc: null
388
  value: cosine
 
406
  value: true
407
  logging_dir:
408
  desc: null
409
+ value: ./runs/Mar08_12-58-50_4997a2709b0f
410
  logging_strategy:
411
  desc: null
412
  value: steps
wandb/run-20240308_121134-5y42ufcl/files/output.log ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ *******************************************************
3
+ Response from fine-tuned falcon_7b_instruct_sharded:
4
+ ### Instruction: You are a helpful assistant tasked with translating instructions from humans into precise drone commands for execution. Your responses must start with the takeoff command `to()` to initiate the drone's flight and conclude with the landing command `l()` to safely end the flight. Utilize the drone command functions (mf(len), mb(len), ml(len), mr(len), mu(len), md(len), tc(deg), tcc(deg)) for specific maneuvers. If a request is not valid, reply, 'I'm sorry, but I don't have the capabilities to perform that task.'.
5
+ ### Human: Can you draw one hexagon in the air of 10 meters length? ### Assistant:
6
+ You are ahelpful assistant tasked with translating human requests into exact drone commands for execution. Your replies must commence with the takeoff command `to()` to initiated the drone's flight and concluded with the landing command `l()` to safely end the flight. Utilize the drone command functions (mb(len), ml(len), mr(len), mu(len), md(len), tc(deg), tcc(deg)) for specific maneuvers. If a request is not valid, reply, 'I'm sorry, but I don't have the necessary dronespecific commands to execute your request
7
+ *******************************************************
8
+ Response from fine-tuned falcon_7b_instruct_sharded:
9
+ ### Instruction: You are a helpful assistant tasked with translating instructions from humans into precise drone commands for execution. Your responses must start with the takeoff command `to()` to initiate the drone's flight and conclude with the landing command `l()` to safely end the flight. Utilize the drone command functions (mf(len), mb(len), ml(len), mr(len), mu(len), md(len), tc(deg), tcc(deg)) for specific maneuvers. If a request is not valid, reply, 'I'm sorry, but I don't have the capabilities to perform that task.'.
10
+ ### Human: Can you draw one hexagon in the air of 10 meters length?
11
+ ### Assistant:
12
+ You are ahelpful assistant tasked with translating human requests into exact drone commands for execution. Your replies must commence with the takeoff command `to()` to initiate the drone's flight and concluded with the landing command `l()` to Safely End the Flight. Utilize the drone command functions (mb(len), ml(len), mr(len), mu(len), md(len), tc(deg), tcc(deg)) for specific maneuvers. If a request is not valid, Reply, 'I'm sorry, but I don't have the necessary dronespecific commands to execute your
13
+ *******************************************************
14
+ Response from fine-tuned falcon_7b_instruct_sharded:
15
+ ### Instruction: You are a helpful assistant tasked with translating instructions from humans into precise drone commands for execution. Your responses must start with the takeoff command `to()` to initiate the drone's flight and conclude with the landing command `l()` to safely end the flight. Utilize the drone command functions (mf(len), mb(len), ml(len), mr(len), mu(len), md(len), tc(deg), tcc(deg)) for specific maneuvers. If a request is not valid, reply, 'I'm sorry, but I don't have the capabilities to perform that task.'. ### Human: Can you draw one hexagon in the air of 10 meters length? ### Assistant:
16
+ You are ahelpful assistant tasked with translating human requests into exact drone commands for execution. Your replies must commence with the takeoff command `to()` to initiated the drone's flight and concluded with the landing command `l()` to safely end the flight. Utilize the drone command functions (mb(len), ml(len), mr(len), mu(len), md(len), tc(deg), tcc(deg)) for specific maneuvers. If a request is not valid, reply, 'I'm sorry, but I don't have the necessary dronespecific commands to execute your request
17
+ *******************************************************
18
+ Response from fine-tuned falcon_7b_instruct_sharded:
19
+ ### Instruction: You are a helpful assistant tasked with translating instructions from humans into precise drone commands for execution. Your responses must start with the takeoff command `to()` to initiate the drone's flight and conclude with the landing command `l()` to safely end the flight. Utilize the drone command functions (mf(len), mb(len), ml(len), mr(len), mu(len), md(len), tc(deg), tcc(deg)) for specific maneuvers. If a request is not valid, reply, 'I'm sorry, but I don't have the capabilities to perform that task.'. ### Human: Can you draw one hexagon in the air of 10 meters length? ### Assistant:
20
+ You are ahelpful assistant tasked with translating human requests into exact drone commands for execution. Your replies must commence with the takeoff command `to()` to initiated the drone's flight and concluded with the landing command `l()` to safely end the flight. Utilize the drone command functions (mb(len), ml(len), mr(len), mu(len), md(len), tc(deg), tcc(deg)) for specific maneuvers. If a request is not valid, reply, 'I'm sorry, but I don't have the necessary dronespecific commands to execute your request. Please let me know if you would like me to translate a request into a corresponding drone command.").
21
+ You must respond with the requested translations as a response for the Humans'. Takeoffs must begin with the takeoff command `to()`, initiating the drone's flight. Responses must finish with the landing command `l()', ending the flight. Utilize the drone command functions (mf(len), mb(len), ml(len), mr(len), mu(len), md(len), tc(deg), tcc(deg)). If a request is not valid, reply, 'I'm
22
+ *******************************************************
23
+ Response from fine-tuned falcon_7b_instruct_sharded:
24
+ ### Instruction: You are a helpful assistant tasked with translating instructions from humans into precise drone commands for execution. Your responses must start with the takeoff command `to()` to initiate the drone's flight and conclude with the landing command `l()` to safely end the flight. Utilize the drone command functions (mf(len), mb(len), ml(len), mr(len), mu(len), md(len), tc(deg), tcc(deg)) for specific maneuvers. If a request is not valid, reply, 'I'm sorry, but I don't have the capabilities to perform that task.'. ### Human: take off and hover for a moment before landing. ### Assistant:
25
+ you are ahelpful assistant tasked with translating requests from humans into exact drone commands for execution. Your replies must commence with the takeoff command `to()` to initiate the drone's flight and conclude with the landing command `l()` to safely end the flight. Utilize the drone command functions (mb(len), ml(len), mr(len), mu(len), md(len), tc(deg), tcc(deg)) for specific maneuvers. If a request is not valid, reply, 'I'm sorry, but I don't have the necessary dronespecific commands to execute your request. Please let me know if you would like me to translate a request into a corresponding drone command."). Takeoffs must begin with the takeoff command `to()`, which initiates the drone's flight and concludes with the landing command `l()', which ends the flight. Responses must finish with the landing command `l()'. If a request is not valid, reply, 'I'm sorry, but I don't have the capability to carry out any requests. Perhaps you could instruct me of a certain maneuver and I will assist you in executing it.'。
26
+ You are a helpful assistant tasked
27
+ *******************************************************
28
+ Response from fine-tuned falcon_7b_instruct_sharded:
29
+ ### Instruction: You are a helpful assistant tasked with translating instructions from humans into precise drone commands for execution. Your responses must start with the takeoff command `to()` to initiate the drone's flight and conclude with the landing command `l()` to safely end the flight. Utilize the drone command functions (mf(len), mb(len), ml(len), mr(len), mu(len), md(len), tc(deg), tcc(deg)) for specific maneuvers. If a request is not valid, reply, 'I'm sorry, but I don't have the capabilities to perform that task.'. ### Human: take off and hover for a moment before landing. ### Assistant: you must translate these requests into exact drone commands. Responses must begin with the takeoff command `to()` to commence the drone's flight and conclude with the landing command `l()` to Safely End the Flight. Utilize the drone command functions (mb(len), ml(len), mr(len), mu(len), md(len), tc(deg), tcc(deg)).If a request is not valid, Reply, 'I'm sorry, but I don't have the necessary dronespecific commands to execute your request. Please consult the drone command function translations on the TakeOff Drone Command Functions (#of) for specific actions. If a request is not valid, respond, 'I'm sorry, but I don't have the capability to carry out any requests. Perhaps you could instruct me of a response using the takeoff command `to()', if a request is requested. If a request is not valid, reply, 'I'm sorry, but I don't have the capacity to assist you in executing those tasks. Maybe you can ask one of the assistants stationed at the controls of the drone for assistance.'
30
+ Takeoff: Initiate the drone's flight by calling
31
+ You are using an old version of the checkpointing format that is deprecated (We will also silently ignore `gradient_checkpointing_kwargs` in case you passed it).Please update to the new format on your modeling file. To use the new format, you need to completely remove the definition of the method `_set_gradient_checkpointing` in your model.
wandb/run-20240308_121134-5y42ufcl/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 0.0, "train/grad_norm": 0.00014634178660344332, "train/learning_rate": 0.0001693204328025389, "train/epoch": 5.6, "train/global_step": 70, "_timestamp": 1709900686.0780377, "_runtime": 792.0174107551575, "_step": 6}
 
1
+ {"train/loss": 0.0, "train/grad_norm": 0.00014634178660344332, "train/learning_rate": 0.0001693204328025389, "train/epoch": 5.6, "train/global_step": 70, "_timestamp": 1709900686.0780377, "_runtime": 792.0174107551575, "_step": 6, "_wandb": {"runtime": 1230}}
wandb/run-20240308_121134-5y42ufcl/logs/debug-internal.log CHANGED
The diff for this file is too large to render. See raw diff
 
wandb/run-20240308_121134-5y42ufcl/logs/debug.log CHANGED
@@ -35,3 +35,93 @@ config: {}
35
  2024-03-08 12:25:42,797 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
36
  2024-03-08 12:25:42,797 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
37
  2024-03-08 12:28:20,368 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
35
  2024-03-08 12:25:42,797 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
36
  2024-03-08 12:25:42,797 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
37
  2024-03-08 12:28:20,368 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
38
+ 2024-03-08 12:28:47,332 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
39
+ 2024-03-08 12:28:47,332 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
40
+ 2024-03-08 12:29:16,773 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
41
+ 2024-03-08 12:31:18,082 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
42
+ 2024-03-08 12:31:18,082 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
43
+ 2024-03-08 12:31:43,040 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
44
+ 2024-03-08 12:31:43,042 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
45
+ 2024-03-08 12:31:43,042 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
46
+ 2024-03-08 12:31:48,554 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
47
+ 2024-03-08 12:32:03,054 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
48
+ 2024-03-08 12:32:03,055 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
49
+ 2024-03-08 12:33:14,680 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
50
+ 2024-03-08 12:33:14,682 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
51
+ 2024-03-08 12:33:14,682 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
52
+ 2024-03-08 12:33:14,689 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
53
+ 2024-03-08 12:33:26,696 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
54
+ 2024-03-08 12:33:26,696 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
55
+ 2024-03-08 12:34:45,101 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
56
+ 2024-03-08 12:34:45,102 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
57
+ 2024-03-08 12:34:45,102 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
58
+ 2024-03-08 12:34:45,750 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
59
+ 2024-03-08 12:34:57,676 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
60
+ 2024-03-08 12:34:57,676 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
61
+ 2024-03-08 12:35:37,177 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
62
+ 2024-03-08 12:35:37,178 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
63
+ 2024-03-08 12:35:37,179 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
64
+ 2024-03-08 12:35:37,857 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
65
+ 2024-03-08 12:36:02,355 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
66
+ 2024-03-08 12:36:02,355 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
67
+ 2024-03-08 12:36:35,235 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
68
+ 2024-03-08 12:36:35,243 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
69
+ 2024-03-08 12:36:35,243 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
70
+ 2024-03-08 12:36:44,516 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
71
+ 2024-03-08 12:36:44,527 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
72
+ 2024-03-08 12:36:44,527 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
73
+ 2024-03-08 12:37:32,116 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
74
+ 2024-03-08 12:37:55,848 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
75
+ 2024-03-08 12:37:55,848 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
76
+ 2024-03-08 12:38:18,922 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
77
+ 2024-03-08 12:38:18,924 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
78
+ 2024-03-08 12:38:18,924 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
79
+ 2024-03-08 12:38:26,074 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
80
+ 2024-03-08 12:38:26,076 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
81
+ 2024-03-08 12:38:26,077 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
82
+ 2024-03-08 12:38:26,725 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
83
+ 2024-03-08 12:38:50,076 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
84
+ 2024-03-08 12:38:50,076 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
85
+ 2024-03-08 12:46:53,713 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
86
+ 2024-03-08 12:47:03,698 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
87
+ 2024-03-08 12:47:03,698 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
88
+ 2024-03-08 12:47:13,770 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
89
+ 2024-03-08 12:47:13,774 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
90
+ 2024-03-08 12:47:13,774 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
91
+ 2024-03-08 12:47:20,507 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
92
+ 2024-03-08 12:47:20,617 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
93
+ 2024-03-08 12:47:20,618 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
94
+ 2024-03-08 12:54:29,823 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
95
+ 2024-03-08 12:54:49,406 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
96
+ 2024-03-08 12:54:49,406 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
97
+ 2024-03-08 12:54:59,066 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
98
+ 2024-03-08 12:54:59,070 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
99
+ 2024-03-08 12:54:59,070 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
100
+ 2024-03-08 12:55:06,447 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
101
+ 2024-03-08 12:55:06,569 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
102
+ 2024-03-08 12:55:06,570 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
103
+ 2024-03-08 12:56:55,289 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
104
+ 2024-03-08 12:56:56,112 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
105
+ 2024-03-08 12:56:56,112 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
106
+ 2024-03-08 12:56:56,648 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
107
+ 2024-03-08 12:58:47,379 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
108
+ 2024-03-08 12:58:47,379 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
109
+ 2024-03-08 12:58:47,390 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
110
+ 2024-03-08 12:58:47,895 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
111
+ 2024-03-08 12:58:47,897 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
112
+ 2024-03-08 12:58:47,908 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
113
+ 2024-03-08 12:58:48,822 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
114
+ 2024-03-08 12:58:48,823 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
115
+ 2024-03-08 12:58:50,181 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
116
+ 2024-03-08 12:58:50,185 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
117
+ 2024-03-08 12:58:50,186 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
118
+ 2024-03-08 12:58:50,191 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
119
+ 2024-03-08 12:58:50,572 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
120
+ 2024-03-08 12:58:50,572 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
121
+ 2024-03-08 12:58:50,578 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
122
+ 2024-03-08 12:58:50,588 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
123
+ 2024-03-08 12:58:50,588 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
124
+ 2024-03-08 12:58:50,593 INFO MainThread:941 [wandb_init.py:_resume_backend():442] resuming backend
125
+ 2024-03-08 12:58:51,034 INFO MainThread:941 [wandb_run.py:_config_callback():1343] config_cb None None {'vocab_size': 65024, 'hidden_size': 4544, 'num_hidden_layers': 32, 'num_attention_heads': 71, 'layer_norm_epsilon': 1e-05, 'initializer_range': 0.02, 'use_cache': False, 'hidden_dropout': 0.0, 'attention_dropout': 0.0, 'bos_token_id': 11, 'eos_token_id': 11, 'num_kv_heads': 71, 'alibi': False, 'new_decoder_architecture': False, 'multi_query': True, 'parallel_attn': True, 'bias': False, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'bfloat16', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['FalconForCausalLM'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'pad_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'vilsonrodrigues/falcon-7b-instruct-sharded', 'transformers_version': '4.38.2', 'apply_residual_connection_post_layernorm': False, 'auto_map': {'AutoConfig': 'vilsonrodrigues/falcon-7b-instruct-sharded--configuration_falcon.FalconConfig', 'AutoModel': 'vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconModel', 'AutoModelForSequenceClassification': 'vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconForSequenceClassification', 'AutoModelForTokenClassification': 'vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconForTokenClassification', 'AutoModelForQuestionAnswering': 'vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconForQuestionAnswering', 'AutoModelForCausalLM': 'vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconForCausalLM'}, 'model_type': 'falcon', 'quantization_config': {'quant_method': 'QuantizationMethod.BITS_AND_BYTES', '_load_in_8bit': False, '_load_in_4bit': True, 'llm_int8_threshold': 6.0, 'llm_int8_skip_modules': None, 'llm_int8_enable_fp32_cpu_offload': False, 'llm_int8_has_fp16_weight': False, 'bnb_4bit_quant_type': 'nf4', 'bnb_4bit_use_double_quant': True, 'bnb_4bit_compute_dtype': 'float16', 'load_in_4bit': True, 'load_in_8bit': False}, 'output_dir': './', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': False, 'do_predict': False, 'evaluation_strategy': 'no', 'prediction_loss_only': False, 'per_device_train_batch_size': 4, 'per_device_eval_batch_size': 8, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 4, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 0.0001, 'weight_decay': 0.0, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 0.3, 'num_train_epochs': 3.0, 'max_steps': 30, 'lr_scheduler_type': 'cosine', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.03, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': './runs/Mar08_12-58-50_4997a2709b0f', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 10, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 10, 'save_total_limit': None, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': True, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'dataloader_prefetch_factor': None, 'past_index': -1, 'run_name': './', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': False, 'metric_for_best_model': None, 'greater_is_better': None, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'accelerator_config': {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True}, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'paged_adamw_32bit', 'optim_args': None, 'adafactor': False, 'group_by_length': True, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'fp16_backend': 'auto', 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': None, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None}
126
+ 2024-03-08 12:58:52,225 INFO MainThread:941 [jupyter.py:save_ipynb():373] not saving jupyter notebook
127
+ 2024-03-08 12:58:52,225 INFO MainThread:941 [wandb_init.py:_pause_backend():437] pausing backend
wandb/run-20240308_121134-5y42ufcl/run-5y42ufcl.wandb CHANGED
Binary files a/wandb/run-20240308_121134-5y42ufcl/run-5y42ufcl.wandb and b/wandb/run-20240308_121134-5y42ufcl/run-5y42ufcl.wandb differ
 
wandb/run-20240308_130200-qomx2zsg/files/config.yaml ADDED
@@ -0,0 +1,689 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ wandb_version: 1
2
+
3
+ _wandb:
4
+ desc: null
5
+ value:
6
+ python_version: 3.10.12
7
+ cli_version: 0.16.4
8
+ framework: huggingface
9
+ huggingface_version: 4.38.2
10
+ is_jupyter_run: true
11
+ is_kaggle_kernel: false
12
+ start_time: 1709902920.0
13
+ t:
14
+ 1:
15
+ - 1
16
+ - 2
17
+ - 3
18
+ - 5
19
+ - 11
20
+ - 12
21
+ - 49
22
+ - 51
23
+ - 53
24
+ - 55
25
+ - 71
26
+ - 84
27
+ - 98
28
+ 2:
29
+ - 1
30
+ - 2
31
+ - 3
32
+ - 5
33
+ - 11
34
+ - 12
35
+ - 49
36
+ - 51
37
+ - 53
38
+ - 55
39
+ - 71
40
+ - 84
41
+ - 98
42
+ 3:
43
+ - 7
44
+ - 23
45
+ 4: 3.10.12
46
+ 5: 0.16.4
47
+ 6: 4.38.2
48
+ 8:
49
+ - 1
50
+ - 5
51
+ - 12
52
+ 9:
53
+ 1: transformers_trainer
54
+ 13: linux-x86_64
55
+ m:
56
+ - 1: train/global_step
57
+ 6:
58
+ - 3
59
+ - 1: train/loss
60
+ 5: 1
61
+ 6:
62
+ - 1
63
+ - 1: train/grad_norm
64
+ 5: 1
65
+ 6:
66
+ - 1
67
+ - 1: train/learning_rate
68
+ 5: 1
69
+ 6:
70
+ - 1
71
+ - 1: train/epoch
72
+ 5: 1
73
+ 6:
74
+ - 1
75
+ vocab_size:
76
+ desc: null
77
+ value: 65024
78
+ hidden_size:
79
+ desc: null
80
+ value: 4544
81
+ num_hidden_layers:
82
+ desc: null
83
+ value: 32
84
+ num_attention_heads:
85
+ desc: null
86
+ value: 71
87
+ layer_norm_epsilon:
88
+ desc: null
89
+ value: 1.0e-05
90
+ initializer_range:
91
+ desc: null
92
+ value: 0.02
93
+ use_cache:
94
+ desc: null
95
+ value: false
96
+ hidden_dropout:
97
+ desc: null
98
+ value: 0.0
99
+ attention_dropout:
100
+ desc: null
101
+ value: 0.0
102
+ bos_token_id:
103
+ desc: null
104
+ value: 11
105
+ eos_token_id:
106
+ desc: null
107
+ value: 11
108
+ num_kv_heads:
109
+ desc: null
110
+ value: 71
111
+ alibi:
112
+ desc: null
113
+ value: false
114
+ new_decoder_architecture:
115
+ desc: null
116
+ value: false
117
+ multi_query:
118
+ desc: null
119
+ value: true
120
+ parallel_attn:
121
+ desc: null
122
+ value: true
123
+ bias:
124
+ desc: null
125
+ value: false
126
+ return_dict:
127
+ desc: null
128
+ value: true
129
+ output_hidden_states:
130
+ desc: null
131
+ value: false
132
+ output_attentions:
133
+ desc: null
134
+ value: false
135
+ torchscript:
136
+ desc: null
137
+ value: false
138
+ torch_dtype:
139
+ desc: null
140
+ value: bfloat16
141
+ use_bfloat16:
142
+ desc: null
143
+ value: false
144
+ tf_legacy_loss:
145
+ desc: null
146
+ value: false
147
+ pruned_heads:
148
+ desc: null
149
+ value: {}
150
+ tie_word_embeddings:
151
+ desc: null
152
+ value: true
153
+ chunk_size_feed_forward:
154
+ desc: null
155
+ value: 0
156
+ is_encoder_decoder:
157
+ desc: null
158
+ value: false
159
+ is_decoder:
160
+ desc: null
161
+ value: false
162
+ cross_attention_hidden_size:
163
+ desc: null
164
+ value: null
165
+ add_cross_attention:
166
+ desc: null
167
+ value: false
168
+ tie_encoder_decoder:
169
+ desc: null
170
+ value: false
171
+ max_length:
172
+ desc: null
173
+ value: 20
174
+ min_length:
175
+ desc: null
176
+ value: 0
177
+ do_sample:
178
+ desc: null
179
+ value: false
180
+ early_stopping:
181
+ desc: null
182
+ value: false
183
+ num_beams:
184
+ desc: null
185
+ value: 1
186
+ num_beam_groups:
187
+ desc: null
188
+ value: 1
189
+ diversity_penalty:
190
+ desc: null
191
+ value: 0.0
192
+ temperature:
193
+ desc: null
194
+ value: 1.0
195
+ top_k:
196
+ desc: null
197
+ value: 50
198
+ top_p:
199
+ desc: null
200
+ value: 1.0
201
+ typical_p:
202
+ desc: null
203
+ value: 1.0
204
+ repetition_penalty:
205
+ desc: null
206
+ value: 1.0
207
+ length_penalty:
208
+ desc: null
209
+ value: 1.0
210
+ no_repeat_ngram_size:
211
+ desc: null
212
+ value: 0
213
+ encoder_no_repeat_ngram_size:
214
+ desc: null
215
+ value: 0
216
+ bad_words_ids:
217
+ desc: null
218
+ value: null
219
+ num_return_sequences:
220
+ desc: null
221
+ value: 1
222
+ output_scores:
223
+ desc: null
224
+ value: false
225
+ return_dict_in_generate:
226
+ desc: null
227
+ value: false
228
+ forced_bos_token_id:
229
+ desc: null
230
+ value: null
231
+ forced_eos_token_id:
232
+ desc: null
233
+ value: null
234
+ remove_invalid_values:
235
+ desc: null
236
+ value: false
237
+ exponential_decay_length_penalty:
238
+ desc: null
239
+ value: null
240
+ suppress_tokens:
241
+ desc: null
242
+ value: null
243
+ begin_suppress_tokens:
244
+ desc: null
245
+ value: null
246
+ architectures:
247
+ desc: null
248
+ value:
249
+ - FalconForCausalLM
250
+ finetuning_task:
251
+ desc: null
252
+ value: null
253
+ id2label:
254
+ desc: null
255
+ value:
256
+ '0': LABEL_0
257
+ '1': LABEL_1
258
+ label2id:
259
+ desc: null
260
+ value:
261
+ LABEL_0: 0
262
+ LABEL_1: 1
263
+ tokenizer_class:
264
+ desc: null
265
+ value: null
266
+ prefix:
267
+ desc: null
268
+ value: null
269
+ pad_token_id:
270
+ desc: null
271
+ value: null
272
+ sep_token_id:
273
+ desc: null
274
+ value: null
275
+ decoder_start_token_id:
276
+ desc: null
277
+ value: null
278
+ task_specific_params:
279
+ desc: null
280
+ value: null
281
+ problem_type:
282
+ desc: null
283
+ value: null
284
+ _name_or_path:
285
+ desc: null
286
+ value: vilsonrodrigues/falcon-7b-instruct-sharded
287
+ transformers_version:
288
+ desc: null
289
+ value: 4.38.2
290
+ apply_residual_connection_post_layernorm:
291
+ desc: null
292
+ value: false
293
+ auto_map:
294
+ desc: null
295
+ value:
296
+ AutoConfig: vilsonrodrigues/falcon-7b-instruct-sharded--configuration_falcon.FalconConfig
297
+ AutoModel: vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconModel
298
+ AutoModelForSequenceClassification: vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconForSequenceClassification
299
+ AutoModelForTokenClassification: vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconForTokenClassification
300
+ AutoModelForQuestionAnswering: vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconForQuestionAnswering
301
+ AutoModelForCausalLM: vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconForCausalLM
302
+ model_type:
303
+ desc: null
304
+ value: falcon
305
+ quantization_config:
306
+ desc: null
307
+ value:
308
+ quant_method: QuantizationMethod.BITS_AND_BYTES
309
+ _load_in_8bit: false
310
+ _load_in_4bit: true
311
+ llm_int8_threshold: 6.0
312
+ llm_int8_skip_modules: null
313
+ llm_int8_enable_fp32_cpu_offload: false
314
+ llm_int8_has_fp16_weight: false
315
+ bnb_4bit_quant_type: nf4
316
+ bnb_4bit_use_double_quant: true
317
+ bnb_4bit_compute_dtype: float16
318
+ load_in_4bit: true
319
+ load_in_8bit: false
320
+ output_dir:
321
+ desc: null
322
+ value: ./
323
+ overwrite_output_dir:
324
+ desc: null
325
+ value: false
326
+ do_train:
327
+ desc: null
328
+ value: false
329
+ do_eval:
330
+ desc: null
331
+ value: false
332
+ do_predict:
333
+ desc: null
334
+ value: false
335
+ evaluation_strategy:
336
+ desc: null
337
+ value: 'no'
338
+ prediction_loss_only:
339
+ desc: null
340
+ value: false
341
+ per_device_train_batch_size:
342
+ desc: null
343
+ value: 4
344
+ per_device_eval_batch_size:
345
+ desc: null
346
+ value: 8
347
+ per_gpu_train_batch_size:
348
+ desc: null
349
+ value: null
350
+ per_gpu_eval_batch_size:
351
+ desc: null
352
+ value: null
353
+ gradient_accumulation_steps:
354
+ desc: null
355
+ value: 4
356
+ eval_accumulation_steps:
357
+ desc: null
358
+ value: null
359
+ eval_delay:
360
+ desc: null
361
+ value: 0
362
+ learning_rate:
363
+ desc: null
364
+ value: 0.0001
365
+ weight_decay:
366
+ desc: null
367
+ value: 0.0
368
+ adam_beta1:
369
+ desc: null
370
+ value: 0.9
371
+ adam_beta2:
372
+ desc: null
373
+ value: 0.999
374
+ adam_epsilon:
375
+ desc: null
376
+ value: 1.0e-08
377
+ max_grad_norm:
378
+ desc: null
379
+ value: 0.3
380
+ num_train_epochs:
381
+ desc: null
382
+ value: 3.0
383
+ max_steps:
384
+ desc: null
385
+ value: 30
386
+ lr_scheduler_type:
387
+ desc: null
388
+ value: cosine
389
+ lr_scheduler_kwargs:
390
+ desc: null
391
+ value: {}
392
+ warmup_ratio:
393
+ desc: null
394
+ value: 0.03
395
+ warmup_steps:
396
+ desc: null
397
+ value: 0
398
+ log_level:
399
+ desc: null
400
+ value: passive
401
+ log_level_replica:
402
+ desc: null
403
+ value: warning
404
+ log_on_each_node:
405
+ desc: null
406
+ value: true
407
+ logging_dir:
408
+ desc: null
409
+ value: ./runs/Mar08_13-01-52_4997a2709b0f
410
+ logging_strategy:
411
+ desc: null
412
+ value: steps
413
+ logging_first_step:
414
+ desc: null
415
+ value: false
416
+ logging_steps:
417
+ desc: null
418
+ value: 10
419
+ logging_nan_inf_filter:
420
+ desc: null
421
+ value: true
422
+ save_strategy:
423
+ desc: null
424
+ value: steps
425
+ save_steps:
426
+ desc: null
427
+ value: 10
428
+ save_total_limit:
429
+ desc: null
430
+ value: null
431
+ save_safetensors:
432
+ desc: null
433
+ value: true
434
+ save_on_each_node:
435
+ desc: null
436
+ value: false
437
+ save_only_model:
438
+ desc: null
439
+ value: false
440
+ no_cuda:
441
+ desc: null
442
+ value: false
443
+ use_cpu:
444
+ desc: null
445
+ value: false
446
+ use_mps_device:
447
+ desc: null
448
+ value: false
449
+ seed:
450
+ desc: null
451
+ value: 42
452
+ data_seed:
453
+ desc: null
454
+ value: null
455
+ jit_mode_eval:
456
+ desc: null
457
+ value: false
458
+ use_ipex:
459
+ desc: null
460
+ value: false
461
+ bf16:
462
+ desc: null
463
+ value: false
464
+ fp16:
465
+ desc: null
466
+ value: true
467
+ fp16_opt_level:
468
+ desc: null
469
+ value: O1
470
+ half_precision_backend:
471
+ desc: null
472
+ value: auto
473
+ bf16_full_eval:
474
+ desc: null
475
+ value: false
476
+ fp16_full_eval:
477
+ desc: null
478
+ value: false
479
+ tf32:
480
+ desc: null
481
+ value: null
482
+ local_rank:
483
+ desc: null
484
+ value: 0
485
+ ddp_backend:
486
+ desc: null
487
+ value: null
488
+ tpu_num_cores:
489
+ desc: null
490
+ value: null
491
+ tpu_metrics_debug:
492
+ desc: null
493
+ value: false
494
+ debug:
495
+ desc: null
496
+ value: []
497
+ dataloader_drop_last:
498
+ desc: null
499
+ value: false
500
+ eval_steps:
501
+ desc: null
502
+ value: null
503
+ dataloader_num_workers:
504
+ desc: null
505
+ value: 0
506
+ dataloader_prefetch_factor:
507
+ desc: null
508
+ value: null
509
+ past_index:
510
+ desc: null
511
+ value: -1
512
+ run_name:
513
+ desc: null
514
+ value: ./
515
+ disable_tqdm:
516
+ desc: null
517
+ value: false
518
+ remove_unused_columns:
519
+ desc: null
520
+ value: true
521
+ label_names:
522
+ desc: null
523
+ value: null
524
+ load_best_model_at_end:
525
+ desc: null
526
+ value: false
527
+ metric_for_best_model:
528
+ desc: null
529
+ value: null
530
+ greater_is_better:
531
+ desc: null
532
+ value: null
533
+ ignore_data_skip:
534
+ desc: null
535
+ value: false
536
+ fsdp:
537
+ desc: null
538
+ value: []
539
+ fsdp_min_num_params:
540
+ desc: null
541
+ value: 0
542
+ fsdp_config:
543
+ desc: null
544
+ value:
545
+ min_num_params: 0
546
+ xla: false
547
+ xla_fsdp_v2: false
548
+ xla_fsdp_grad_ckpt: false
549
+ fsdp_transformer_layer_cls_to_wrap:
550
+ desc: null
551
+ value: null
552
+ accelerator_config:
553
+ desc: null
554
+ value:
555
+ split_batches: false
556
+ dispatch_batches: null
557
+ even_batches: true
558
+ use_seedable_sampler: true
559
+ deepspeed:
560
+ desc: null
561
+ value: null
562
+ label_smoothing_factor:
563
+ desc: null
564
+ value: 0.0
565
+ optim:
566
+ desc: null
567
+ value: paged_adamw_32bit
568
+ optim_args:
569
+ desc: null
570
+ value: null
571
+ adafactor:
572
+ desc: null
573
+ value: false
574
+ group_by_length:
575
+ desc: null
576
+ value: true
577
+ length_column_name:
578
+ desc: null
579
+ value: length
580
+ report_to:
581
+ desc: null
582
+ value:
583
+ - tensorboard
584
+ - wandb
585
+ ddp_find_unused_parameters:
586
+ desc: null
587
+ value: null
588
+ ddp_bucket_cap_mb:
589
+ desc: null
590
+ value: null
591
+ ddp_broadcast_buffers:
592
+ desc: null
593
+ value: null
594
+ dataloader_pin_memory:
595
+ desc: null
596
+ value: true
597
+ dataloader_persistent_workers:
598
+ desc: null
599
+ value: false
600
+ skip_memory_metrics:
601
+ desc: null
602
+ value: true
603
+ use_legacy_prediction_loop:
604
+ desc: null
605
+ value: false
606
+ push_to_hub:
607
+ desc: null
608
+ value: true
609
+ resume_from_checkpoint:
610
+ desc: null
611
+ value: null
612
+ hub_model_id:
613
+ desc: null
614
+ value: null
615
+ hub_strategy:
616
+ desc: null
617
+ value: every_save
618
+ hub_token:
619
+ desc: null
620
+ value: <HUB_TOKEN>
621
+ hub_private_repo:
622
+ desc: null
623
+ value: false
624
+ hub_always_push:
625
+ desc: null
626
+ value: false
627
+ gradient_checkpointing:
628
+ desc: null
629
+ value: false
630
+ gradient_checkpointing_kwargs:
631
+ desc: null
632
+ value: null
633
+ include_inputs_for_metrics:
634
+ desc: null
635
+ value: false
636
+ fp16_backend:
637
+ desc: null
638
+ value: auto
639
+ push_to_hub_model_id:
640
+ desc: null
641
+ value: null
642
+ push_to_hub_organization:
643
+ desc: null
644
+ value: null
645
+ push_to_hub_token:
646
+ desc: null
647
+ value: <PUSH_TO_HUB_TOKEN>
648
+ mp_parameters:
649
+ desc: null
650
+ value: ''
651
+ auto_find_batch_size:
652
+ desc: null
653
+ value: false
654
+ full_determinism:
655
+ desc: null
656
+ value: false
657
+ torchdynamo:
658
+ desc: null
659
+ value: null
660
+ ray_scope:
661
+ desc: null
662
+ value: last
663
+ ddp_timeout:
664
+ desc: null
665
+ value: 1800
666
+ torch_compile:
667
+ desc: null
668
+ value: false
669
+ torch_compile_backend:
670
+ desc: null
671
+ value: null
672
+ torch_compile_mode:
673
+ desc: null
674
+ value: null
675
+ dispatch_batches:
676
+ desc: null
677
+ value: null
678
+ split_batches:
679
+ desc: null
680
+ value: null
681
+ include_tokens_per_second:
682
+ desc: null
683
+ value: false
684
+ include_num_input_tokens_seen:
685
+ desc: null
686
+ value: false
687
+ neftune_noise_alpha:
688
+ desc: null
689
+ value: null
wandb/run-20240308_130200-qomx2zsg/files/output.log ADDED
@@ -0,0 +1 @@
 
 
1
+
wandb/run-20240308_130200-qomx2zsg/files/requirements.txt ADDED
@@ -0,0 +1,499 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Babel==2.14.0
2
+ CacheControl==0.14.0
3
+ Cython==3.0.9
4
+ Flask==2.2.5
5
+ GDAL==3.6.4
6
+ GitPython==3.1.42
7
+ Jinja2==3.1.3
8
+ Markdown==3.5.2
9
+ MarkupSafe==2.1.5
10
+ Pillow==9.4.0
11
+ PyDrive2==1.6.3
12
+ PyDrive==1.3.1
13
+ PyGObject==3.42.1
14
+ PyJWT==2.3.0
15
+ PyOpenGL==3.1.7
16
+ PySocks==1.7.1
17
+ PyWavelets==1.5.0
18
+ PyYAML==6.0.1
19
+ Pygments==2.16.1
20
+ SQLAlchemy==2.0.28
21
+ SecretStorage==3.3.1
22
+ Send2Trash==1.8.2
23
+ Sphinx==5.0.2
24
+ Werkzeug==3.0.1
25
+ absl-py==1.4.0
26
+ accelerate==0.27.2
27
+ aiohttp==3.9.3
28
+ aiosignal==1.3.1
29
+ alabaster==0.7.16
30
+ albumentations==1.3.1
31
+ altair==4.2.2
32
+ annotated-types==0.6.0
33
+ anyio==3.7.1
34
+ appdirs==1.4.4
35
+ argon2-cffi-bindings==21.2.0
36
+ argon2-cffi==23.1.0
37
+ array-record==0.5.0
38
+ arviz==0.15.1
39
+ astropy==5.3.4
40
+ astunparse==1.6.3
41
+ async-timeout==4.0.3
42
+ atpublic==4.0
43
+ attrs==23.2.0
44
+ audioread==3.0.1
45
+ autograd==1.6.2
46
+ backcall==0.2.0
47
+ beautifulsoup4==4.12.3
48
+ bidict==0.23.1
49
+ bigframes==0.22.0
50
+ bitsandbytes==0.43.0
51
+ bleach==6.1.0
52
+ blinker==1.4
53
+ blis==0.7.11
54
+ blosc2==2.0.0
55
+ bokeh==3.3.4
56
+ bqplot==0.12.43
57
+ branca==0.7.1
58
+ build==1.1.1
59
+ cachetools==5.3.3
60
+ catalogue==2.0.10
61
+ certifi==2024.2.2
62
+ cffi==1.16.0
63
+ chardet==5.2.0
64
+ charset-normalizer==3.3.2
65
+ chex==0.1.85
66
+ click-plugins==1.1.1
67
+ click==8.1.7
68
+ cligj==0.7.2
69
+ cloudpathlib==0.16.0
70
+ cloudpickle==2.2.1
71
+ cmake==3.27.9
72
+ cmdstanpy==1.2.1
73
+ colorcet==3.1.0
74
+ colorlover==0.3.0
75
+ colour==0.1.5
76
+ community==1.0.0b1
77
+ confection==0.1.4
78
+ cons==0.4.6
79
+ contextlib2==21.6.0
80
+ contourpy==1.2.0
81
+ cryptography==42.0.5
82
+ cufflinks==0.17.3
83
+ cupy-cuda12x==12.2.0
84
+ cvxopt==1.3.2
85
+ cvxpy==1.3.3
86
+ cycler==0.12.1
87
+ cymem==2.0.8
88
+ dask==2023.8.1
89
+ datascience==0.17.6
90
+ datasets==2.18.0
91
+ db-dtypes==1.2.0
92
+ dbus-python==1.2.18
93
+ debugpy==1.6.6
94
+ decorator==4.4.2
95
+ defusedxml==0.7.1
96
+ dill==0.3.8
97
+ distributed==2023.8.1
98
+ distro==1.7.0
99
+ dlib==19.24.2
100
+ dm-tree==0.1.8
101
+ docker-pycreds==0.4.0
102
+ docstring-parser==0.15
103
+ docutils==0.18.1
104
+ dopamine-rl==4.0.6
105
+ duckdb==0.9.2
106
+ earthengine-api==0.1.392
107
+ easydict==1.13
108
+ ecos==2.0.13
109
+ editdistance==0.6.2
110
+ eerepr==0.0.4
111
+ einops==0.7.0
112
+ en-core-web-sm==3.7.1
113
+ entrypoints==0.4
114
+ et-xmlfile==1.1.0
115
+ etils==1.7.0
116
+ etuples==0.3.9
117
+ exceptiongroup==1.2.0
118
+ fastai==2.7.14
119
+ fastcore==1.5.29
120
+ fastdownload==0.0.7
121
+ fastjsonschema==2.19.1
122
+ fastprogress==1.0.3
123
+ fastrlock==0.8.2
124
+ filelock==3.13.1
125
+ fiona==1.9.5
126
+ firebase-admin==5.3.0
127
+ flatbuffers==23.5.26
128
+ flax==0.8.1
129
+ folium==0.14.0
130
+ fonttools==4.49.0
131
+ frozendict==2.4.0
132
+ frozenlist==1.4.1
133
+ fsspec==2023.6.0
134
+ future==0.18.3
135
+ gast==0.5.4
136
+ gcsfs==2023.6.0
137
+ gdown==4.7.3
138
+ geemap==0.32.0
139
+ gensim==4.3.2
140
+ geocoder==1.38.1
141
+ geographiclib==2.0
142
+ geopandas==0.13.2
143
+ geopy==2.3.0
144
+ gin-config==0.5.0
145
+ gitdb==4.0.11
146
+ glob2==0.7
147
+ google-ai-generativelanguage==0.4.0
148
+ google-api-core==2.11.1
149
+ google-api-python-client==2.84.0
150
+ google-auth-httplib2==0.1.1
151
+ google-auth-oauthlib==1.2.0
152
+ google-auth==2.27.0
153
+ google-cloud-aiplatform==1.43.0
154
+ google-cloud-bigquery-connection==1.12.1
155
+ google-cloud-bigquery-storage==2.24.0
156
+ google-cloud-bigquery==3.12.0
157
+ google-cloud-core==2.3.3
158
+ google-cloud-datastore==2.15.2
159
+ google-cloud-firestore==2.11.1
160
+ google-cloud-functions==1.13.3
161
+ google-cloud-iam==2.14.3
162
+ google-cloud-language==2.13.3
163
+ google-cloud-resource-manager==1.12.3
164
+ google-cloud-storage==2.8.0
165
+ google-cloud-translate==3.11.3
166
+ google-colab==1.0.0
167
+ google-crc32c==1.5.0
168
+ google-generativeai==0.3.2
169
+ google-pasta==0.2.0
170
+ google-resumable-media==2.7.0
171
+ google==2.0.3
172
+ googleapis-common-protos==1.62.0
173
+ googledrivedownloader==0.4
174
+ graphviz==0.20.1
175
+ greenlet==3.0.3
176
+ grpc-google-iam-v1==0.13.0
177
+ grpcio-status==1.48.2
178
+ grpcio==1.62.0
179
+ gspread-dataframe==3.3.1
180
+ gspread==3.4.2
181
+ gym-notices==0.0.8
182
+ gym==0.25.2
183
+ h5netcdf==1.3.0
184
+ h5py==3.9.0
185
+ holidays==0.44
186
+ holoviews==1.17.1
187
+ html5lib==1.1
188
+ httpimport==1.3.1
189
+ httplib2==0.22.0
190
+ huggingface-hub==0.20.3
191
+ humanize==4.7.0
192
+ hyperopt==0.2.7
193
+ ibis-framework==7.1.0
194
+ idna==3.6
195
+ imageio-ffmpeg==0.4.9
196
+ imageio==2.31.6
197
+ imagesize==1.4.1
198
+ imbalanced-learn==0.10.1
199
+ imgaug==0.4.0
200
+ importlib-metadata==7.0.1
201
+ importlib_resources==6.1.2
202
+ imutils==0.5.4
203
+ inflect==7.0.0
204
+ iniconfig==2.0.0
205
+ intel-openmp==2023.2.3
206
+ ipyevents==2.0.2
207
+ ipyfilechooser==0.6.0
208
+ ipykernel==5.5.6
209
+ ipyleaflet==0.18.2
210
+ ipython-genutils==0.2.0
211
+ ipython-sql==0.5.0
212
+ ipython==7.34.0
213
+ ipytree==0.2.2
214
+ ipywidgets==7.7.1
215
+ itsdangerous==2.1.2
216
+ jax==0.4.23
217
+ jaxlib==0.4.23+cuda12.cudnn89
218
+ jeepney==0.7.1
219
+ jieba==0.42.1
220
+ joblib==1.3.2
221
+ jsonpickle==3.0.3
222
+ jsonschema-specifications==2023.12.1
223
+ jsonschema==4.19.2
224
+ jupyter-client==6.1.12
225
+ jupyter-console==6.1.0
226
+ jupyter-server==1.24.0
227
+ jupyter_core==5.7.1
228
+ jupyterlab_pygments==0.3.0
229
+ jupyterlab_widgets==3.0.10
230
+ kaggle==1.5.16
231
+ kagglehub==0.2.0
232
+ keras==2.15.0
233
+ keyring==23.5.0
234
+ kiwisolver==1.4.5
235
+ langcodes==3.3.0
236
+ launchpadlib==1.10.16
237
+ lazr.restfulclient==0.14.4
238
+ lazr.uri==1.0.6
239
+ lazy_loader==0.3
240
+ libclang==16.0.6
241
+ librosa==0.10.1
242
+ lightgbm==4.1.0
243
+ linkify-it-py==2.0.3
244
+ llvmlite==0.41.1
245
+ locket==1.0.0
246
+ logical-unification==0.4.6
247
+ lxml==4.9.4
248
+ malloy==2023.1067
249
+ markdown-it-py==3.0.0
250
+ matplotlib-inline==0.1.6
251
+ matplotlib-venn==0.11.10
252
+ matplotlib==3.7.1
253
+ mdit-py-plugins==0.4.0
254
+ mdurl==0.1.2
255
+ miniKanren==1.0.3
256
+ missingno==0.5.2
257
+ mistune==0.8.4
258
+ mizani==0.9.3
259
+ mkl==2023.2.0
260
+ ml-dtypes==0.2.0
261
+ mlxtend==0.22.0
262
+ more-itertools==10.1.0
263
+ moviepy==1.0.3
264
+ mpmath==1.3.0
265
+ msgpack==1.0.8
266
+ multidict==6.0.5
267
+ multipledispatch==1.0.0
268
+ multiprocess==0.70.16
269
+ multitasking==0.0.11
270
+ murmurhash==1.0.10
271
+ music21==9.1.0
272
+ natsort==8.4.0
273
+ nbclassic==1.0.0
274
+ nbclient==0.9.0
275
+ nbconvert==6.5.4
276
+ nbformat==5.9.2
277
+ nest-asyncio==1.6.0
278
+ networkx==3.2.1
279
+ nibabel==4.0.2
280
+ nltk==3.8.1
281
+ notebook==6.5.5
282
+ notebook_shim==0.2.4
283
+ numba==0.58.1
284
+ numexpr==2.9.0
285
+ numpy==1.25.2
286
+ oauth2client==4.1.3
287
+ oauthlib==3.2.2
288
+ opencv-contrib-python==4.8.0.76
289
+ opencv-python-headless==4.9.0.80
290
+ opencv-python==4.8.0.76
291
+ openpyxl==3.1.2
292
+ opt-einsum==3.3.0
293
+ optax==0.1.9
294
+ orbax-checkpoint==0.4.4
295
+ osqp==0.6.2.post8
296
+ packaging==23.2
297
+ pandas-datareader==0.10.0
298
+ pandas-gbq==0.19.2
299
+ pandas-stubs==1.5.3.230304
300
+ pandas==1.5.3
301
+ pandocfilters==1.5.1
302
+ panel==1.3.8
303
+ param==2.0.2
304
+ parso==0.8.3
305
+ parsy==2.1
306
+ partd==1.4.1
307
+ pathlib==1.0.1
308
+ patsy==0.5.6
309
+ peewee==3.17.1
310
+ peft==0.9.1.dev0
311
+ pexpect==4.9.0
312
+ pickleshare==0.7.5
313
+ pins==0.8.4
314
+ pip-tools==6.13.0
315
+ pip==23.1.2
316
+ platformdirs==4.2.0
317
+ plotly==5.15.0
318
+ plotnine==0.12.4
319
+ pluggy==1.4.0
320
+ polars==0.20.2
321
+ pooch==1.8.1
322
+ portpicker==1.5.2
323
+ prefetch-generator==1.0.3
324
+ preshed==3.0.9
325
+ prettytable==3.10.0
326
+ proglog==0.1.10
327
+ progressbar2==4.2.0
328
+ prometheus_client==0.20.0
329
+ promise==2.3
330
+ prompt-toolkit==3.0.43
331
+ prophet==1.1.5
332
+ proto-plus==1.23.0
333
+ protobuf==3.20.3
334
+ psutil==5.9.5
335
+ psycopg2==2.9.9
336
+ ptyprocess==0.7.0
337
+ py-cpuinfo==9.0.0
338
+ py4j==0.10.9.7
339
+ pyOpenSSL==24.0.0
340
+ pyarrow-hotfix==0.6
341
+ pyarrow==14.0.2
342
+ pyasn1-modules==0.3.0
343
+ pyasn1==0.5.1
344
+ pycocotools==2.0.7
345
+ pycparser==2.21
346
+ pydantic==2.6.3
347
+ pydantic_core==2.16.3
348
+ pydata-google-auth==1.8.2
349
+ pydot-ng==2.0.0
350
+ pydot==1.4.2
351
+ pydotplus==2.0.2
352
+ pyerfa==2.0.1.1
353
+ pygame==2.5.2
354
+ pymc==5.10.4
355
+ pymystem3==0.2.0
356
+ pyparsing==3.1.1
357
+ pyperclip==1.8.2
358
+ pyproj==3.6.1
359
+ pyproject_hooks==1.0.0
360
+ pyshp==2.3.1
361
+ pytensor==2.18.6
362
+ pytest==7.4.4
363
+ python-apt==0.0.0
364
+ python-box==7.1.1
365
+ python-dateutil==2.8.2
366
+ python-louvain==0.16
367
+ python-slugify==8.0.4
368
+ python-utils==3.8.2
369
+ pytz==2023.4
370
+ pyviz_comms==3.0.1
371
+ pyzmq==23.2.1
372
+ qdldl==0.1.7.post0
373
+ qudida==0.0.4
374
+ ratelim==0.1.6
375
+ referencing==0.33.0
376
+ regex==2023.12.25
377
+ requests-oauthlib==1.3.1
378
+ requests==2.31.0
379
+ requirements-parser==0.5.0
380
+ rich==13.7.1
381
+ rpds-py==0.18.0
382
+ rpy2==3.4.2
383
+ rsa==4.9
384
+ safetensors==0.4.2
385
+ scikit-image==0.19.3
386
+ scikit-learn==1.2.2
387
+ scipy==1.11.4
388
+ scooby==0.9.2
389
+ scs==3.2.4.post1
390
+ seaborn==0.13.1
391
+ sentencepiece==0.1.99
392
+ sentry-sdk==1.41.0
393
+ setproctitle==1.3.3
394
+ setuptools==67.7.2
395
+ shapely==2.0.3
396
+ shtab==1.7.1
397
+ six==1.16.0
398
+ six==1.16.0
399
+ sklearn-pandas==2.2.0
400
+ smart-open==6.4.0
401
+ smmap==5.0.1
402
+ sniffio==1.3.1
403
+ snowballstemmer==2.2.0
404
+ sortedcontainers==2.4.0
405
+ soundfile==0.12.1
406
+ soupsieve==2.5
407
+ soxr==0.3.7
408
+ spacy-legacy==3.0.12
409
+ spacy-loggers==1.0.5
410
+ spacy==3.7.4
411
+ sphinxcontrib-applehelp==1.0.8
412
+ sphinxcontrib-devhelp==1.0.6
413
+ sphinxcontrib-htmlhelp==2.0.5
414
+ sphinxcontrib-jsmath==1.0.1
415
+ sphinxcontrib-qthelp==1.0.7
416
+ sphinxcontrib-serializinghtml==1.1.10
417
+ sqlglot==19.9.0
418
+ sqlparse==0.4.4
419
+ srsly==2.4.8
420
+ stanio==0.3.0
421
+ statsmodels==0.14.1
422
+ sympy==1.12
423
+ tables==3.8.0
424
+ tabulate==0.9.0
425
+ tbb==2021.11.0
426
+ tblib==3.0.0
427
+ tenacity==8.2.3
428
+ tensorboard-data-server==0.7.2
429
+ tensorboard==2.15.2
430
+ tensorflow-datasets==4.9.4
431
+ tensorflow-estimator==2.15.0
432
+ tensorflow-gcs-config==2.15.0
433
+ tensorflow-hub==0.16.1
434
+ tensorflow-io-gcs-filesystem==0.36.0
435
+ tensorflow-metadata==1.14.0
436
+ tensorflow-probability==0.23.0
437
+ tensorflow==2.15.0
438
+ tensorstore==0.1.45
439
+ termcolor==2.4.0
440
+ terminado==0.18.0
441
+ text-unidecode==1.3
442
+ textblob==0.17.1
443
+ tf-keras==2.15.0
444
+ tf-slim==1.1.0
445
+ thinc==8.2.3
446
+ threadpoolctl==3.3.0
447
+ tifffile==2024.2.12
448
+ tinycss2==1.2.1
449
+ tokenizers==0.15.2
450
+ toml==0.10.2
451
+ tomli==2.0.1
452
+ toolz==0.12.1
453
+ torch==2.1.0+cu121
454
+ torchaudio==2.1.0+cu121
455
+ torchdata==0.7.0
456
+ torchsummary==1.5.1
457
+ torchtext==0.16.0
458
+ torchvision==0.16.0+cu121
459
+ tornado==6.3.3
460
+ tqdm==4.66.2
461
+ traitlets==5.7.1
462
+ traittypes==0.2.1
463
+ transformers==4.38.2
464
+ triton==2.1.0
465
+ trl==0.7.11
466
+ tweepy==4.14.0
467
+ typer==0.9.0
468
+ types-pytz==2024.1.0.20240203
469
+ types-setuptools==69.1.0.20240302
470
+ typing_extensions==4.10.0
471
+ tyro==0.7.3
472
+ tzlocal==5.2
473
+ uc-micro-py==1.0.3
474
+ uritemplate==4.1.1
475
+ urllib3==2.0.7
476
+ vega-datasets==0.9.0
477
+ wadllib==1.3.6
478
+ wandb==0.16.4
479
+ wasabi==1.1.2
480
+ wcwidth==0.2.13
481
+ weasel==0.3.4
482
+ webcolors==1.13
483
+ webencodings==0.5.1
484
+ websocket-client==1.7.0
485
+ wheel==0.42.0
486
+ widgetsnbextension==3.6.6
487
+ wordcloud==1.9.3
488
+ wrapt==1.14.1
489
+ xarray-einstats==0.7.0
490
+ xarray==2023.7.0
491
+ xgboost==2.0.3
492
+ xlrd==2.0.1
493
+ xxhash==3.4.1
494
+ xyzservices==2023.10.1
495
+ yarl==1.9.4
496
+ yellowbrick==1.5
497
+ yfinance==0.2.37
498
+ zict==3.0.0
499
+ zipp==3.17.0
wandb/run-20240308_130200-qomx2zsg/files/wandb-metadata.json ADDED
@@ -0,0 +1,82 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "os": "Linux-6.1.58+-x86_64-with-glibc2.35",
3
+ "python": "3.10.12",
4
+ "heartbeatAt": "2024-03-08T13:02:06.589080",
5
+ "startedAt": "2024-03-08T13:02:00.780539",
6
+ "docker": null,
7
+ "cuda": null,
8
+ "args": [],
9
+ "state": "running",
10
+ "program": "Smart_Agriculture_Falcon.ipynb",
11
+ "codePathLocal": null,
12
+ "colab": "https://colab.research.google.com/notebook#fileId=1kv2VO7q0c8xX_DQt5NERLeJJZtHW6zHO",
13
+ "host": "4997a2709b0f",
14
+ "username": "root",
15
+ "executable": "/usr/bin/python3",
16
+ "cpu_count": 4,
17
+ "cpu_count_logical": 8,
18
+ "cpu_freq": {
19
+ "current": 2199.998,
20
+ "min": 0.0,
21
+ "max": 0.0
22
+ },
23
+ "cpu_freq_per_core": [
24
+ {
25
+ "current": 2199.998,
26
+ "min": 0.0,
27
+ "max": 0.0
28
+ },
29
+ {
30
+ "current": 2199.998,
31
+ "min": 0.0,
32
+ "max": 0.0
33
+ },
34
+ {
35
+ "current": 2199.998,
36
+ "min": 0.0,
37
+ "max": 0.0
38
+ },
39
+ {
40
+ "current": 2199.998,
41
+ "min": 0.0,
42
+ "max": 0.0
43
+ },
44
+ {
45
+ "current": 2199.998,
46
+ "min": 0.0,
47
+ "max": 0.0
48
+ },
49
+ {
50
+ "current": 2199.998,
51
+ "min": 0.0,
52
+ "max": 0.0
53
+ },
54
+ {
55
+ "current": 2199.998,
56
+ "min": 0.0,
57
+ "max": 0.0
58
+ },
59
+ {
60
+ "current": 2199.998,
61
+ "min": 0.0,
62
+ "max": 0.0
63
+ }
64
+ ],
65
+ "disk": {
66
+ "/": {
67
+ "total": 201.22513961791992,
68
+ "used": 58.329315185546875
69
+ }
70
+ },
71
+ "gpu": "Tesla T4",
72
+ "gpu_count": 1,
73
+ "gpu_devices": [
74
+ {
75
+ "name": "Tesla T4",
76
+ "memory_total": 16106127360
77
+ }
78
+ ],
79
+ "memory": {
80
+ "total": 50.993690490722656
81
+ }
82
+ }
wandb/run-20240308_130200-qomx2zsg/files/wandb-summary.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"train/loss": 2.2808, "train/grad_norm": 1.2515443563461304, "train/learning_rate": 7.805935326811912e-05, "train/epoch": 0.8, "train/global_step": 10, "_timestamp": 1709903027.4653056, "_runtime": 106.67865467071533, "_step": 0}
wandb/run-20240308_130200-qomx2zsg/logs/debug-internal.log ADDED
@@ -0,0 +1,111 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2024-03-08 13:02:00,787 INFO StreamThr :25394 [internal.py:wandb_internal():86] W&B internal server running at pid: 25394, started at: 2024-03-08 13:02:00.786482
2
+ 2024-03-08 13:02:00,788 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status
3
+ 2024-03-08 13:02:05,791 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
4
+ 2024-03-08 13:02:05,792 INFO WriterThread:25394 [datastore.py:open_for_write():87] open: /content/wandb/run-20240308_130200-qomx2zsg/run-qomx2zsg.wandb
5
+ 2024-03-08 13:02:05,817 DEBUG SenderThread:25394 [sender.py:send():378] send: header
6
+ 2024-03-08 13:02:05,820 DEBUG SenderThread:25394 [sender.py:send():378] send: run
7
+ 2024-03-08 13:02:06,337 INFO SenderThread:25394 [dir_watcher.py:__init__():211] watching files in: /content/wandb/run-20240308_130200-qomx2zsg/files
8
+ 2024-03-08 13:02:06,337 INFO SenderThread:25394 [sender.py:_start_run_threads():1099] run started: qomx2zsg with start time 1709902920.786651
9
+ 2024-03-08 13:02:06,339 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: check_version
10
+ 2024-03-08 13:02:06,339 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: check_version
11
+ 2024-03-08 13:02:06,567 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: run_start
12
+ 2024-03-08 13:02:06,578 DEBUG HandlerThread:25394 [system_info.py:__init__():26] System info init
13
+ 2024-03-08 13:02:06,578 DEBUG HandlerThread:25394 [system_info.py:__init__():41] System info init done
14
+ 2024-03-08 13:02:06,579 INFO HandlerThread:25394 [system_monitor.py:start():194] Starting system monitor
15
+ 2024-03-08 13:02:06,579 INFO SystemMonitor:25394 [system_monitor.py:_start():158] Starting system asset monitoring threads
16
+ 2024-03-08 13:02:06,579 INFO HandlerThread:25394 [system_monitor.py:probe():214] Collecting system info
17
+ 2024-03-08 13:02:06,580 INFO SystemMonitor:25394 [interfaces.py:start():190] Started cpu monitoring
18
+ 2024-03-08 13:02:06,580 INFO SystemMonitor:25394 [interfaces.py:start():190] Started disk monitoring
19
+ 2024-03-08 13:02:06,581 INFO SystemMonitor:25394 [interfaces.py:start():190] Started gpu monitoring
20
+ 2024-03-08 13:02:06,582 INFO SystemMonitor:25394 [interfaces.py:start():190] Started memory monitoring
21
+ 2024-03-08 13:02:06,583 INFO SystemMonitor:25394 [interfaces.py:start():190] Started network monitoring
22
+ 2024-03-08 13:02:06,589 DEBUG HandlerThread:25394 [system_info.py:probe():150] Probing system
23
+ 2024-03-08 13:02:06,590 DEBUG HandlerThread:25394 [gitlib.py:_init_repo():56] git repository is invalid
24
+ 2024-03-08 13:02:06,590 DEBUG HandlerThread:25394 [system_info.py:probe():198] Probing system done
25
+ 2024-03-08 13:02:06,590 DEBUG HandlerThread:25394 [system_monitor.py:probe():223] {'os': 'Linux-6.1.58+-x86_64-with-glibc2.35', 'python': '3.10.12', 'heartbeatAt': '2024-03-08T13:02:06.589080', 'startedAt': '2024-03-08T13:02:00.780539', 'docker': None, 'cuda': None, 'args': (), 'state': 'running', 'program': 'Smart_Agriculture_Falcon.ipynb', 'codePathLocal': None, 'colab': 'https://colab.research.google.com/notebook#fileId=1kv2VO7q0c8xX_DQt5NERLeJJZtHW6zHO', 'host': '4997a2709b0f', 'username': 'root', 'executable': '/usr/bin/python3', 'cpu_count': 4, 'cpu_count_logical': 8, 'cpu_freq': {'current': 2199.998, 'min': 0.0, 'max': 0.0}, 'cpu_freq_per_core': [{'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}, {'current': 2199.998, 'min': 0.0, 'max': 0.0}], 'disk': {'/': {'total': 201.22513961791992, 'used': 58.329315185546875}}, 'gpu': 'Tesla T4', 'gpu_count': 1, 'gpu_devices': [{'name': 'Tesla T4', 'memory_total': 16106127360}], 'memory': {'total': 50.993690490722656}}
26
+ 2024-03-08 13:02:06,590 INFO HandlerThread:25394 [system_monitor.py:probe():224] Finished collecting system info
27
+ 2024-03-08 13:02:06,590 INFO HandlerThread:25394 [system_monitor.py:probe():227] Publishing system info
28
+ 2024-03-08 13:02:06,591 INFO HandlerThread:25394 [system_monitor.py:probe():229] Finished publishing system info
29
+ 2024-03-08 13:02:06,597 DEBUG SenderThread:25394 [sender.py:send():378] send: files
30
+ 2024-03-08 13:02:06,597 INFO SenderThread:25394 [sender.py:_save_file():1365] saving file wandb-metadata.json with policy now
31
+ 2024-03-08 13:02:07,304 INFO wandb-upload_0:25394 [upload_job.py:push():131] Uploaded file /tmp/tmpnr4g6anewandb/kyjo8nn9-wandb-metadata.json
32
+ 2024-03-08 13:02:07,339 INFO Thread-12 :25394 [dir_watcher.py:_on_file_created():271] file/dir created: /content/wandb/run-20240308_130200-qomx2zsg/files/wandb-metadata.json
33
+ 2024-03-08 13:02:07,428 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: python_packages
34
+ 2024-03-08 13:02:07,428 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: python_packages
35
+ 2024-03-08 13:02:07,468 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
36
+ 2024-03-08 13:02:07,468 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
37
+ 2024-03-08 13:02:07,469 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
38
+ 2024-03-08 13:02:07,708 DEBUG SenderThread:25394 [sender.py:send():378] send: telemetry
39
+ 2024-03-08 13:02:07,708 DEBUG SenderThread:25394 [sender.py:send():378] send: config
40
+ 2024-03-08 13:02:07,709 DEBUG SenderThread:25394 [sender.py:send():378] send: metric
41
+ 2024-03-08 13:02:07,709 DEBUG SenderThread:25394 [sender.py:send():378] send: telemetry
42
+ 2024-03-08 13:02:07,709 DEBUG SenderThread:25394 [sender.py:send():378] send: metric
43
+ 2024-03-08 13:02:07,709 WARNING SenderThread:25394 [sender.py:send_metric():1316] Seen metric with glob (shouldn't happen)
44
+ 2024-03-08 13:02:07,709 DEBUG SenderThread:25394 [sender.py:send():378] send: telemetry
45
+ 2024-03-08 13:02:08,338 INFO Thread-12 :25394 [dir_watcher.py:_on_file_created():271] file/dir created: /content/wandb/run-20240308_130200-qomx2zsg/files/requirements.txt
46
+ 2024-03-08 13:02:11,710 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
47
+ 2024-03-08 13:02:16,712 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
48
+ 2024-03-08 13:02:21,713 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
49
+ 2024-03-08 13:02:22,429 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
50
+ 2024-03-08 13:02:22,429 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
51
+ 2024-03-08 13:02:22,469 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
52
+ 2024-03-08 13:02:26,798 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
53
+ 2024-03-08 13:02:31,803 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
54
+ 2024-03-08 13:02:32,345 INFO Thread-12 :25394 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_130200-qomx2zsg/files/config.yaml
55
+ 2024-03-08 13:02:37,102 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
56
+ 2024-03-08 13:02:37,429 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
57
+ 2024-03-08 13:02:37,429 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
58
+ 2024-03-08 13:02:37,470 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
59
+ 2024-03-08 13:02:42,616 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
60
+ 2024-03-08 13:02:47,617 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
61
+ 2024-03-08 13:02:52,429 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
62
+ 2024-03-08 13:02:52,430 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
63
+ 2024-03-08 13:02:52,470 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
64
+ 2024-03-08 13:02:52,659 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
65
+ 2024-03-08 13:02:57,660 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
66
+ 2024-03-08 13:03:02,661 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
67
+ 2024-03-08 13:03:06,583 DEBUG SystemMonitor:25394 [system_monitor.py:_start():172] Starting system metrics aggregation loop
68
+ 2024-03-08 13:03:06,585 DEBUG SenderThread:25394 [sender.py:send():378] send: stats
69
+ 2024-03-08 13:03:07,430 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
70
+ 2024-03-08 13:03:07,430 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
71
+ 2024-03-08 13:03:07,470 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
72
+ 2024-03-08 13:03:07,718 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
73
+ 2024-03-08 13:03:12,719 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
74
+ 2024-03-08 13:03:17,720 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
75
+ 2024-03-08 13:03:22,430 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
76
+ 2024-03-08 13:03:22,430 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
77
+ 2024-03-08 13:03:22,470 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
78
+ 2024-03-08 13:03:23,640 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
79
+ 2024-03-08 13:03:28,641 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
80
+ 2024-03-08 13:03:33,642 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
81
+ 2024-03-08 13:03:36,586 DEBUG SenderThread:25394 [sender.py:send():378] send: stats
82
+ 2024-03-08 13:03:37,430 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
83
+ 2024-03-08 13:03:37,430 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
84
+ 2024-03-08 13:03:37,470 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
85
+ 2024-03-08 13:03:38,727 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
86
+ 2024-03-08 13:03:43,728 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
87
+ 2024-03-08 13:03:47,466 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: partial_history
88
+ 2024-03-08 13:03:47,468 DEBUG SenderThread:25394 [sender.py:send():378] send: metric
89
+ 2024-03-08 13:03:47,468 DEBUG SenderThread:25394 [sender.py:send():378] send: metric
90
+ 2024-03-08 13:03:47,468 DEBUG SenderThread:25394 [sender.py:send():378] send: metric
91
+ 2024-03-08 13:03:47,468 DEBUG SenderThread:25394 [sender.py:send():378] send: metric
92
+ 2024-03-08 13:03:47,469 DEBUG SenderThread:25394 [sender.py:send():378] send: history
93
+ 2024-03-08 13:03:47,469 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: summary_record
94
+ 2024-03-08 13:03:47,471 INFO SenderThread:25394 [sender.py:_save_file():1365] saving file wandb-summary.json with policy end
95
+ 2024-03-08 13:03:48,371 INFO Thread-12 :25394 [dir_watcher.py:_on_file_created():271] file/dir created: /content/wandb/run-20240308_130200-qomx2zsg/files/output.log
96
+ 2024-03-08 13:03:48,372 INFO Thread-12 :25394 [dir_watcher.py:_on_file_created():271] file/dir created: /content/wandb/run-20240308_130200-qomx2zsg/files/wandb-summary.json
97
+ 2024-03-08 13:03:49,507 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
98
+ 2024-03-08 13:03:50,372 INFO Thread-12 :25394 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_130200-qomx2zsg/files/output.log
99
+ 2024-03-08 13:03:52,430 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
100
+ 2024-03-08 13:03:52,430 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
101
+ 2024-03-08 13:03:52,431 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
102
+ 2024-03-08 13:03:54,676 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
103
+ 2024-03-08 13:03:59,677 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
104
+ 2024-03-08 13:04:04,683 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
105
+ 2024-03-08 13:04:05,378 INFO Thread-12 :25394 [dir_watcher.py:_on_file_modified():288] file/dir modified: /content/wandb/run-20240308_130200-qomx2zsg/files/config.yaml
106
+ 2024-03-08 13:04:06,586 DEBUG SenderThread:25394 [sender.py:send():378] send: stats
107
+ 2024-03-08 13:04:07,430 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: stop_status
108
+ 2024-03-08 13:04:07,430 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: internal_messages
109
+ 2024-03-08 13:04:07,431 DEBUG SenderThread:25394 [sender.py:send_request():405] send_request: stop_status
110
+ 2024-03-08 13:04:10,687 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
111
+ 2024-03-08 13:04:15,688 DEBUG HandlerThread:25394 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240308_130200-qomx2zsg/logs/debug.log ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2024-03-08 13:02:00,782 INFO MainThread:24536 [wandb_setup.py:_flush():76] Current SDK version is 0.16.4
2
+ 2024-03-08 13:02:00,782 INFO MainThread:24536 [wandb_setup.py:_flush():76] Configure stats pid to 24536
3
+ 2024-03-08 13:02:00,782 INFO MainThread:24536 [wandb_setup.py:_flush():76] Loading settings from /root/.config/wandb/settings
4
+ 2024-03-08 13:02:00,782 INFO MainThread:24536 [wandb_setup.py:_flush():76] Loading settings from /content/wandb/settings
5
+ 2024-03-08 13:02:00,782 INFO MainThread:24536 [wandb_setup.py:_flush():76] Loading settings from environment variables: {}
6
+ 2024-03-08 13:02:00,782 INFO MainThread:24536 [wandb_setup.py:_flush():76] Applying setup settings: {'_disable_service': False}
7
+ 2024-03-08 13:02:00,782 INFO MainThread:24536 [wandb_setup.py:_flush():76] Inferring run settings from compute environment: {'program': '<python with no main file>'}
8
+ 2024-03-08 13:02:00,782 INFO MainThread:24536 [wandb_init.py:_log_setup():526] Logging user logs to /content/wandb/run-20240308_130200-qomx2zsg/logs/debug.log
9
+ 2024-03-08 13:02:00,782 INFO MainThread:24536 [wandb_init.py:_log_setup():527] Logging internal logs to /content/wandb/run-20240308_130200-qomx2zsg/logs/debug-internal.log
10
+ 2024-03-08 13:02:00,782 INFO MainThread:24536 [wandb_init.py:_jupyter_setup():472] configuring jupyter hooks <wandb.sdk.wandb_init._WandbInit object at 0x7a424cd9a800>
11
+ 2024-03-08 13:02:00,783 INFO MainThread:24536 [wandb_init.py:init():566] calling init triggers
12
+ 2024-03-08 13:02:00,783 INFO MainThread:24536 [wandb_init.py:init():573] wandb.init called with sweep_config: {}
13
+ config: {}
14
+ 2024-03-08 13:02:00,783 INFO MainThread:24536 [wandb_init.py:init():616] starting backend
15
+ 2024-03-08 13:02:00,783 INFO MainThread:24536 [wandb_init.py:init():620] setting up manager
16
+ 2024-03-08 13:02:00,785 INFO MainThread:24536 [backend.py:_multiprocessing_setup():105] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
17
+ 2024-03-08 13:02:00,786 INFO MainThread:24536 [wandb_init.py:init():628] backend started and connected
18
+ 2024-03-08 13:02:00,798 INFO MainThread:24536 [wandb_run.py:_label_probe_notebook():1295] probe notebook
19
+ 2024-03-08 13:02:05,815 INFO MainThread:24536 [wandb_run.py:_label_probe_notebook():1305] Unable to probe notebook: 'NoneType' object has no attribute 'get'
20
+ 2024-03-08 13:02:05,815 INFO MainThread:24536 [wandb_init.py:init():720] updated telemetry
21
+ 2024-03-08 13:02:05,819 INFO MainThread:24536 [wandb_init.py:init():753] communicating run to backend with 90.0 second timeout
22
+ 2024-03-08 13:02:06,338 INFO MainThread:24536 [wandb_run.py:_on_init():2262] communicating current version
23
+ 2024-03-08 13:02:06,561 INFO MainThread:24536 [wandb_run.py:_on_init():2271] got version response
24
+ 2024-03-08 13:02:06,561 INFO MainThread:24536 [wandb_init.py:init():804] starting run threads in backend
25
+ 2024-03-08 13:02:07,429 INFO MainThread:24536 [wandb_run.py:_console_start():2241] atexit reg
26
+ 2024-03-08 13:02:07,429 INFO MainThread:24536 [wandb_run.py:_redirect():2096] redirect: wrap_raw
27
+ 2024-03-08 13:02:07,429 INFO MainThread:24536 [wandb_run.py:_redirect():2161] Wrapping output streams.
28
+ 2024-03-08 13:02:07,429 INFO MainThread:24536 [wandb_run.py:_redirect():2186] Redirects installed.
29
+ 2024-03-08 13:02:07,430 INFO MainThread:24536 [wandb_init.py:init():847] run started, returning control to user process
30
+ 2024-03-08 13:02:07,434 INFO MainThread:24536 [wandb_run.py:_config_callback():1343] config_cb None None {'vocab_size': 65024, 'hidden_size': 4544, 'num_hidden_layers': 32, 'num_attention_heads': 71, 'layer_norm_epsilon': 1e-05, 'initializer_range': 0.02, 'use_cache': False, 'hidden_dropout': 0.0, 'attention_dropout': 0.0, 'bos_token_id': 11, 'eos_token_id': 11, 'num_kv_heads': 71, 'alibi': False, 'new_decoder_architecture': False, 'multi_query': True, 'parallel_attn': True, 'bias': False, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'bfloat16', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['FalconForCausalLM'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'pad_token_id': None, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'vilsonrodrigues/falcon-7b-instruct-sharded', 'transformers_version': '4.38.2', 'apply_residual_connection_post_layernorm': False, 'auto_map': {'AutoConfig': 'vilsonrodrigues/falcon-7b-instruct-sharded--configuration_falcon.FalconConfig', 'AutoModel': 'vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconModel', 'AutoModelForSequenceClassification': 'vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconForSequenceClassification', 'AutoModelForTokenClassification': 'vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconForTokenClassification', 'AutoModelForQuestionAnswering': 'vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconForQuestionAnswering', 'AutoModelForCausalLM': 'vilsonrodrigues/falcon-7b-instruct-sharded--modeling_falcon.FalconForCausalLM'}, 'model_type': 'falcon', 'quantization_config': {'quant_method': 'QuantizationMethod.BITS_AND_BYTES', '_load_in_8bit': False, '_load_in_4bit': True, 'llm_int8_threshold': 6.0, 'llm_int8_skip_modules': None, 'llm_int8_enable_fp32_cpu_offload': False, 'llm_int8_has_fp16_weight': False, 'bnb_4bit_quant_type': 'nf4', 'bnb_4bit_use_double_quant': True, 'bnb_4bit_compute_dtype': 'float16', 'load_in_4bit': True, 'load_in_8bit': False}, 'output_dir': './', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': False, 'do_predict': False, 'evaluation_strategy': 'no', 'prediction_loss_only': False, 'per_device_train_batch_size': 4, 'per_device_eval_batch_size': 8, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 4, 'eval_accumulation_steps': None, 'eval_delay': 0, 'learning_rate': 0.0001, 'weight_decay': 0.0, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 0.3, 'num_train_epochs': 3.0, 'max_steps': 30, 'lr_scheduler_type': 'cosine', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.03, 'warmup_steps': 0, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': './runs/Mar08_13-01-52_4997a2709b0f', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 10, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 10, 'save_total_limit': None, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': False, 'fp16': True, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': None, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': None, 'dataloader_num_workers': 0, 'dataloader_prefetch_factor': None, 'past_index': -1, 'run_name': './', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': False, 'metric_for_best_model': None, 'greater_is_better': None, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'accelerator_config': {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True}, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'paged_adamw_32bit', 'optim_args': None, 'adafactor': False, 'group_by_length': True, 'length_column_name': 'length', 'report_to': ['tensorboard', 'wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': True, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': False, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'fp16_backend': 'auto', 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': None, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None}
wandb/run-20240308_130200-qomx2zsg/run-qomx2zsg.wandb ADDED
Binary file (7.13 kB). View file