sanchit-gandhi's picture
Saving weights and logs of epoch 0
cac475f
raw
history blame contribute delete
No virus
7.29 kB
2022-04-04 18:10:27,962 INFO MainThread:1241191 [wandb_setup.py:_flush():75] Loading settings from /home/sanchitgandhi/.config/wandb/settings
2022-04-04 18:10:27,962 INFO MainThread:1241191 [wandb_setup.py:_flush():75] Loading settings from wandb/settings
2022-04-04 18:10:27,962 INFO MainThread:1241191 [wandb_setup.py:_flush():75] Loading settings from environment variables: {'entity': 'sanchit-gandhi', 'project': 'flax-wav2vec2-2-bart-large-cnn', 'sweep_id': 'a50sny4c', 'root_dir': '/home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn', 'run_id': 'mgg9caus', 'sweep_param_path': '/home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/sweep-a50sny4c/config-mgg9caus.yaml'}
2022-04-04 18:10:27,962 INFO MainThread:1241191 [wandb_setup.py:_flush():75] Inferring run settings from compute environment: {'program_relpath': 'run_flax_speech_recognition_seq2seq.py', 'program': 'run_flax_speech_recognition_seq2seq.py'}
2022-04-04 18:10:27,963 INFO MainThread:1241191 [wandb_init.py:_log_setup():405] Logging user logs to /home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/run-20220404_181027-mgg9caus/logs/debug.log
2022-04-04 18:10:27,963 INFO MainThread:1241191 [wandb_init.py:_log_setup():406] Logging internal logs to /home/sanchitgandhi/flax-wav2vec2-2-bart-large-cnn/wandb/run-20220404_181027-mgg9caus/logs/debug-internal.log
2022-04-04 18:10:27,963 INFO MainThread:1241191 [wandb_init.py:init():439] calling init triggers
2022-04-04 18:10:27,963 INFO MainThread:1241191 [wandb_init.py:init():442] wandb.init called with sweep_config: {'dataset_cache_dir': '/home/sanchitgandhi/cache/huggingface/datasets', 'dataset_config_name': 'clean', 'dataset_name': 'librispeech_asr', 'eval_split_name': 'validation', 'generation_max_length': 40, 'generation_num_beams': 1, 'gradient_accumulation_steps': 1, 'learning_rate': 0.0006871268347239357, 'length_column_name': 'input_length', 'logging_steps': 1, 'matmul_precision': 'highest', 'max_duration_in_seconds': 15, 'max_target_length': 64, 'min_duration_in_seconds': 15, 'model_name_or_path': './', 'num_train_epochs': 5, 'output_dir': './', 'per_device_eval_batch_size': 2, 'per_device_train_batch_size': 2, 'preprocessing_num_workers': 16, 'text_column_name': 'text', 'train_split_name': 'train.100', 'wandb_project': 'flax-wav2vec2-2-bart-large-cnn', 'warmup_steps': 500}
config: {}
2022-04-04 18:10:27,963 INFO MainThread:1241191 [wandb_init.py:init():492] starting backend
2022-04-04 18:10:27,963 INFO MainThread:1241191 [backend.py:_multiprocessing_setup():99] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
2022-04-04 18:10:27,976 INFO MainThread:1241191 [backend.py:ensure_launched():219] starting backend process...
2022-04-04 18:10:27,984 INFO MainThread:1241191 [backend.py:ensure_launched():224] started backend process with pid: 1241646
2022-04-04 18:10:27,986 INFO MainThread:1241191 [wandb_init.py:init():501] backend started and connected
2022-04-04 18:10:27,992 INFO MainThread:1241191 [wandb_run.py:_config_callback():992] config_cb None None {'dataset_cache_dir': '/home/sanchitgandhi/cache/huggingface/datasets', 'dataset_config_name': 'clean', 'dataset_name': 'librispeech_asr', 'eval_split_name': 'validation', 'generation_max_length': 40, 'generation_num_beams': 1, 'gradient_accumulation_steps': 1, 'learning_rate': 0.0006871268347239357, 'length_column_name': 'input_length', 'logging_steps': 1, 'matmul_precision': 'highest', 'max_duration_in_seconds': 15, 'max_target_length': 64, 'min_duration_in_seconds': 15, 'model_name_or_path': './', 'num_train_epochs': 5, 'output_dir': './', 'per_device_eval_batch_size': 2, 'per_device_train_batch_size': 2, 'preprocessing_num_workers': 16, 'text_column_name': 'text', 'train_split_name': 'train.100', 'wandb_project': 'flax-wav2vec2-2-bart-large-cnn', 'warmup_steps': 500}
2022-04-04 18:10:27,996 INFO MainThread:1241191 [wandb_init.py:init():565] updated telemetry
2022-04-04 18:10:28,015 INFO MainThread:1241191 [wandb_init.py:init():596] communicating run to backend with 30 second timeout
2022-04-04 18:10:28,793 INFO MainThread:1241191 [wandb_run.py:_on_init():1759] communicating current version
2022-04-04 18:10:28,852 INFO MainThread:1241191 [wandb_run.py:_on_init():1763] got version response
2022-04-04 18:10:28,852 INFO MainThread:1241191 [wandb_init.py:init():625] starting run threads in backend
2022-04-04 18:10:31,094 INFO MainThread:1241191 [wandb_run.py:_console_start():1733] atexit reg
2022-04-04 18:10:31,094 INFO MainThread:1241191 [wandb_run.py:_redirect():1606] redirect: SettingsConsole.REDIRECT
2022-04-04 18:10:31,095 INFO MainThread:1241191 [wandb_run.py:_redirect():1611] Redirecting console.
2022-04-04 18:10:31,096 INFO MainThread:1241191 [wandb_run.py:_redirect():1667] Redirects installed.
2022-04-04 18:10:31,097 INFO MainThread:1241191 [wandb_init.py:init():664] run started, returning control to user process
2022-04-04 18:10:50,720 INFO MainThread:1241191 [wandb_run.py:_atexit_cleanup():1702] got exitcode: 1
2022-04-04 18:10:50,724 INFO MainThread:1241191 [wandb_run.py:_restore():1674] restore
2022-04-04 18:10:53,238 INFO MainThread:1241191 [wandb_run.py:_on_finish():1831] got exit ret: file_counts {
wandb_count: 1
}
pusher_stats {
uploaded_bytes: 1948
total_bytes: 1948
}
2022-04-04 18:10:53,393 INFO MainThread:1241191 [wandb_run.py:_on_finish():1831] got exit ret: file_counts {
wandb_count: 1
}
pusher_stats {
uploaded_bytes: 1948
total_bytes: 1948
}
2022-04-04 18:10:53,806 INFO MainThread:1241191 [wandb_run.py:_on_finish():1831] got exit ret: file_counts {
wandb_count: 4
}
pusher_stats {
uploaded_bytes: 1948
total_bytes: 45265
}
2022-04-04 18:10:53,908 INFO MainThread:1241191 [wandb_run.py:_on_finish():1831] got exit ret: file_counts {
wandb_count: 5
}
pusher_stats {
uploaded_bytes: 45292
total_bytes: 45292
}
2022-04-04 18:10:54,009 INFO MainThread:1241191 [wandb_run.py:_on_finish():1831] got exit ret: file_counts {
wandb_count: 5
}
pusher_stats {
uploaded_bytes: 45292
total_bytes: 45292
}
2022-04-04 18:10:54,111 INFO MainThread:1241191 [wandb_run.py:_on_finish():1831] got exit ret: file_counts {
wandb_count: 5
}
pusher_stats {
uploaded_bytes: 45292
total_bytes: 45292
}
2022-04-04 18:10:54,213 INFO MainThread:1241191 [wandb_run.py:_on_finish():1831] got exit ret: file_counts {
wandb_count: 5
}
pusher_stats {
uploaded_bytes: 45292
total_bytes: 45292
}
2022-04-04 18:10:54,431 INFO MainThread:1241191 [wandb_run.py:_on_finish():1831] got exit ret: file_counts {
wandb_count: 5
}
pusher_stats {
uploaded_bytes: 45292
total_bytes: 45292
}
2022-04-04 18:10:54,585 INFO MainThread:1241191 [wandb_run.py:_on_finish():1831] got exit ret: done: true
exit_result {
}
file_counts {
wandb_count: 5
}
pusher_stats {
uploaded_bytes: 45292
total_bytes: 45292
}
local_info {
}
2022-04-04 18:10:56,074 INFO MainThread:1241191 [wandb_run.py:_footer_history_summary_info():2865] rendering history
2022-04-04 18:10:56,074 INFO MainThread:1241191 [wandb_run.py:_footer_history_summary_info():2894] rendering summary
2022-04-04 18:10:56,075 INFO MainThread:1241191 [wandb_run.py:_footer_sync_info():2822] logging synced files