File size: 7,292 Bytes
cac475f
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
2022-04-04 18:10:27,962 INFO    MainThread:1241191 [wandb_setup.py:_flush():75] Loading settings from /home/sanchitgandhi/.config/wandb/settings
2022-04-04 18:10:27,962 INFO    MainThread:1241191 [wandb_setup.py:_flush():75] Loading settings from wandb/settings
2022-04-04 18:10:27,962 INFO    MainThread:1241191 [wandb_setup.py:_flush():75] Loading settings from environment variables: {'entity': 'sanchit-gandhi', 'project': 'flax-wav2vec2-2-bart-large-cnn', 'sweep_id': 'a50sny4c', 'root_dir': '/home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn', 'run_id': 'mgg9caus', 'sweep_param_path': '/home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/sweep-a50sny4c/config-mgg9caus.yaml'}
2022-04-04 18:10:27,962 INFO    MainThread:1241191 [wandb_setup.py:_flush():75] Inferring run settings from compute environment: {'program_relpath': 'run_flax_speech_recognition_seq2seq.py', 'program': 'run_flax_speech_recognition_seq2seq.py'}
2022-04-04 18:10:27,963 INFO    MainThread:1241191 [wandb_init.py:_log_setup():405] Logging user logs to /home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/run-20220404_181027-mgg9caus/logs/debug.log
2022-04-04 18:10:27,963 INFO    MainThread:1241191 [wandb_init.py:_log_setup():406] Logging internal logs to /home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/run-20220404_181027-mgg9caus/logs/debug-internal.log
2022-04-04 18:10:27,963 INFO    MainThread:1241191 [wandb_init.py:init():439] calling init triggers
2022-04-04 18:10:27,963 INFO    MainThread:1241191 [wandb_init.py:init():442] wandb.init called with sweep_config: {'dataset_cache_dir': '/home/sanchitgandhi/cache/huggingface/datasets', 'dataset_config_name': 'clean', 'dataset_name': 'librispeech_asr', 'eval_split_name': 'validation', 'generation_max_length': 40, 'generation_num_beams': 1, 'gradient_accumulation_steps': 1, 'learning_rate': 0.0006871268347239357, 'length_column_name': 'input_length', 'logging_steps': 1, 'matmul_precision': 'highest', 'max_duration_in_seconds': 15, 'max_target_length': 64, 'min_duration_in_seconds': 15, 'model_name_or_path': './', 'num_train_epochs': 5, 'output_dir': './', 'per_device_eval_batch_size': 2, 'per_device_train_batch_size': 2, 'preprocessing_num_workers': 16, 'text_column_name': 'text', 'train_split_name': 'train.100', 'wandb_project': 'flax-wav2vec2-2-bart-large-cnn', 'warmup_steps': 500}
config: {}
2022-04-04 18:10:27,963 INFO    MainThread:1241191 [wandb_init.py:init():492] starting backend
2022-04-04 18:10:27,963 INFO    MainThread:1241191 [backend.py:_multiprocessing_setup():99] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
2022-04-04 18:10:27,976 INFO    MainThread:1241191 [backend.py:ensure_launched():219] starting backend process...
2022-04-04 18:10:27,984 INFO    MainThread:1241191 [backend.py:ensure_launched():224] started backend process with pid: 1241646
2022-04-04 18:10:27,986 INFO    MainThread:1241191 [wandb_init.py:init():501] backend started and connected
2022-04-04 18:10:27,992 INFO    MainThread:1241191 [wandb_run.py:_config_callback():992] config_cb None None {'dataset_cache_dir': '/home/sanchitgandhi/cache/huggingface/datasets', 'dataset_config_name': 'clean', 'dataset_name': 'librispeech_asr', 'eval_split_name': 'validation', 'generation_max_length': 40, 'generation_num_beams': 1, 'gradient_accumulation_steps': 1, 'learning_rate': 0.0006871268347239357, 'length_column_name': 'input_length', 'logging_steps': 1, 'matmul_precision': 'highest', 'max_duration_in_seconds': 15, 'max_target_length': 64, 'min_duration_in_seconds': 15, 'model_name_or_path': './', 'num_train_epochs': 5, 'output_dir': './', 'per_device_eval_batch_size': 2, 'per_device_train_batch_size': 2, 'preprocessing_num_workers': 16, 'text_column_name': 'text', 'train_split_name': 'train.100', 'wandb_project': 'flax-wav2vec2-2-bart-large-cnn', 'warmup_steps': 500}
2022-04-04 18:10:27,996 INFO    MainThread:1241191 [wandb_init.py:init():565] updated telemetry
2022-04-04 18:10:28,015 INFO    MainThread:1241191 [wandb_init.py:init():596] communicating run to backend with 30 second timeout
2022-04-04 18:10:28,793 INFO    MainThread:1241191 [wandb_run.py:_on_init():1759] communicating current version
2022-04-04 18:10:28,852 INFO    MainThread:1241191 [wandb_run.py:_on_init():1763] got version response 
2022-04-04 18:10:28,852 INFO    MainThread:1241191 [wandb_init.py:init():625] starting run threads in backend
2022-04-04 18:10:31,094 INFO    MainThread:1241191 [wandb_run.py:_console_start():1733] atexit reg
2022-04-04 18:10:31,094 INFO    MainThread:1241191 [wandb_run.py:_redirect():1606] redirect: SettingsConsole.REDIRECT
2022-04-04 18:10:31,095 INFO    MainThread:1241191 [wandb_run.py:_redirect():1611] Redirecting console.
2022-04-04 18:10:31,096 INFO    MainThread:1241191 [wandb_run.py:_redirect():1667] Redirects installed.
2022-04-04 18:10:31,097 INFO    MainThread:1241191 [wandb_init.py:init():664] run started, returning control to user process
2022-04-04 18:10:50,720 INFO    MainThread:1241191 [wandb_run.py:_atexit_cleanup():1702] got exitcode: 1
2022-04-04 18:10:50,724 INFO    MainThread:1241191 [wandb_run.py:_restore():1674] restore
2022-04-04 18:10:53,238 INFO    MainThread:1241191 [wandb_run.py:_on_finish():1831] got exit ret: file_counts {
  wandb_count: 1
}
pusher_stats {
  uploaded_bytes: 1948
  total_bytes: 1948
}

2022-04-04 18:10:53,393 INFO    MainThread:1241191 [wandb_run.py:_on_finish():1831] got exit ret: file_counts {
  wandb_count: 1
}
pusher_stats {
  uploaded_bytes: 1948
  total_bytes: 1948
}

2022-04-04 18:10:53,806 INFO    MainThread:1241191 [wandb_run.py:_on_finish():1831] got exit ret: file_counts {
  wandb_count: 4
}
pusher_stats {
  uploaded_bytes: 1948
  total_bytes: 45265
}

2022-04-04 18:10:53,908 INFO    MainThread:1241191 [wandb_run.py:_on_finish():1831] got exit ret: file_counts {
  wandb_count: 5
}
pusher_stats {
  uploaded_bytes: 45292
  total_bytes: 45292
}

2022-04-04 18:10:54,009 INFO    MainThread:1241191 [wandb_run.py:_on_finish():1831] got exit ret: file_counts {
  wandb_count: 5
}
pusher_stats {
  uploaded_bytes: 45292
  total_bytes: 45292
}

2022-04-04 18:10:54,111 INFO    MainThread:1241191 [wandb_run.py:_on_finish():1831] got exit ret: file_counts {
  wandb_count: 5
}
pusher_stats {
  uploaded_bytes: 45292
  total_bytes: 45292
}

2022-04-04 18:10:54,213 INFO    MainThread:1241191 [wandb_run.py:_on_finish():1831] got exit ret: file_counts {
  wandb_count: 5
}
pusher_stats {
  uploaded_bytes: 45292
  total_bytes: 45292
}

2022-04-04 18:10:54,431 INFO    MainThread:1241191 [wandb_run.py:_on_finish():1831] got exit ret: file_counts {
  wandb_count: 5
}
pusher_stats {
  uploaded_bytes: 45292
  total_bytes: 45292
}

2022-04-04 18:10:54,585 INFO    MainThread:1241191 [wandb_run.py:_on_finish():1831] got exit ret: done: true
exit_result {
}
file_counts {
  wandb_count: 5
}
pusher_stats {
  uploaded_bytes: 45292
  total_bytes: 45292
}
local_info {
}

2022-04-04 18:10:56,074 INFO    MainThread:1241191 [wandb_run.py:_footer_history_summary_info():2865] rendering history
2022-04-04 18:10:56,074 INFO    MainThread:1241191 [wandb_run.py:_footer_history_summary_info():2894] rendering summary
2022-04-04 18:10:56,075 INFO    MainThread:1241191 [wandb_run.py:_footer_sync_info():2822] logging synced files