| 2024-05-13 20:52:49,015 INFO MainThread:1257680 [wandb_setup.py:_flush():76] Current SDK version is 0.17.0 | |
| 2024-05-13 20:52:49,015 INFO MainThread:1257680 [wandb_setup.py:_flush():76] Configure stats pid to 1257680 | |
| 2024-05-13 20:52:49,015 INFO MainThread:1257680 [wandb_setup.py:_flush():76] Loading settings from /home/sanchit/.config/wandb/settings | |
| 2024-05-13 20:52:49,015 INFO MainThread:1257680 [wandb_setup.py:_flush():76] Loading settings from /raid/sanchit/parler-tts-mini-v0.1-expresso-concatenated-combined/wandb/settings | |
| 2024-05-13 20:52:49,015 INFO MainThread:1257680 [wandb_setup.py:_flush():76] Loading settings from environment variables: {} | |
| 2024-05-13 20:52:49,015 INFO MainThread:1257680 [wandb_setup.py:_flush():76] Applying setup settings: {'_disable_service': False} | |
| 2024-05-13 20:52:49,015 INFO MainThread:1257680 [wandb_setup.py:_flush():76] Inferring run settings from compute environment: {'program_relpath': 'run_parler_tts_training.py', 'program_abspath': '/raid/sanchit/parler-tts-mini-v0.1-expresso-concatenated-combined/run_parler_tts_training.py', 'program': '/raid/sanchit/parler-tts-mini-v0.1-expresso-concatenated-combined/run_parler_tts_training.py'} | |
| 2024-05-13 20:52:49,015 INFO MainThread:1257680 [wandb_setup.py:_flush():76] Applying login settings: {} | |
| 2024-05-13 20:52:49,015 INFO MainThread:1257680 [wandb_init.py:_log_setup():520] Logging user logs to /raid/sanchit/parler-tts-mini-v0.1-expresso-concatenated-combined/wandb/run-20240513_205249-qaoje1x9/logs/debug.log | |
| 2024-05-13 20:52:49,015 INFO MainThread:1257680 [wandb_init.py:_log_setup():521] Logging internal logs to /raid/sanchit/parler-tts-mini-v0.1-expresso-concatenated-combined/wandb/run-20240513_205249-qaoje1x9/logs/debug-internal.log | |
| 2024-05-13 20:52:49,015 INFO MainThread:1257680 [wandb_init.py:init():560] calling init triggers | |
| 2024-05-13 20:52:49,015 INFO MainThread:1257680 [wandb_init.py:init():567] wandb.init called with sweep_config: {} | |
| config: {} | |
| 2024-05-13 20:52:49,015 INFO MainThread:1257680 [wandb_init.py:init():610] starting backend | |
| 2024-05-13 20:52:49,015 INFO MainThread:1257680 [wandb_init.py:init():614] setting up manager | |
| 2024-05-13 20:52:49,019 INFO MainThread:1257680 [backend.py:_multiprocessing_setup():105] multiprocessing start_methods=fork,spawn,forkserver, using: spawn | |
| 2024-05-13 20:52:49,019 INFO MainThread:1257680 [wandb_init.py:init():622] backend started and connected | |
| 2024-05-13 20:52:49,021 INFO MainThread:1257680 [wandb_init.py:init():711] updated telemetry | |
| 2024-05-13 20:52:49,024 INFO MainThread:1257680 [wandb_init.py:init():744] communicating run to backend with 90.0 second timeout | |
| 2024-05-13 20:52:49,413 INFO MainThread:1257680 [wandb_run.py:_on_init():2396] communicating current version | |
| 2024-05-13 20:52:49,474 INFO MainThread:1257680 [wandb_run.py:_on_init():2405] got version response | |
| 2024-05-13 20:52:49,475 INFO MainThread:1257680 [wandb_init.py:init():795] starting run threads in backend | |
| 2024-05-13 20:52:52,103 INFO MainThread:1257680 [wandb_run.py:_console_start():2374] atexit reg | |
| 2024-05-13 20:52:52,103 INFO MainThread:1257680 [wandb_run.py:_redirect():2229] redirect: wrap_raw | |
| 2024-05-13 20:52:52,103 INFO MainThread:1257680 [wandb_run.py:_redirect():2294] Wrapping output streams. | |
| 2024-05-13 20:52:52,103 INFO MainThread:1257680 [wandb_run.py:_redirect():2319] Redirects installed. | |
| 2024-05-13 20:52:52,104 INFO MainThread:1257680 [wandb_init.py:init():838] run started, returning control to user process | |
| 2024-05-13 20:52:52,104 INFO MainThread:1257680 [wandb_run.py:_config_callback():1376] config_cb None None {'learning_rate': 8e-05, 'model_name_or_path': 'parler-tts/parler_tts_mini_v0.1', 'num_train_epochs': 8, 'gradient_accumulation_steps': 8, 'per_device_train_batch_size': 16, 'global_batch_size': 16, 'mixed_precision': 'bf16', 'lr_scheduler_type': 'SchedulerType.COSINE', 'warmup_steps': 250, 'freeze_text_encoder': True, 'max_duration_in_seconds': 30.0, 'weight_decay': 0.01, 'adam_beta1': 0.9, 'adam_beta2': 0.99, 'temperature': 1.0} | |
| 2024-05-13 23:01:32,489 INFO MainThread:1257680 [wandb_run.py:_finish():2103] finishing run sanchit-gandhi/parler-speech/qaoje1x9 | |
| 2024-05-13 23:01:32,489 INFO MainThread:1257680 [wandb_run.py:_atexit_cleanup():2343] got exitcode: 0 | |
| 2024-05-13 23:01:32,489 INFO MainThread:1257680 [wandb_run.py:_restore():2326] restore | |
| 2024-05-13 23:01:32,489 INFO MainThread:1257680 [wandb_run.py:_restore():2332] restore done | |
| 2024-05-13 23:01:46,253 INFO MainThread:1257680 [wandb_run.py:_footer_history_summary_info():3994] rendering history | |
| 2024-05-13 23:01:46,254 INFO MainThread:1257680 [wandb_run.py:_footer_history_summary_info():4026] rendering summary | |
| 2024-05-13 23:01:46,256 INFO MainThread:1257680 [wandb_run.py:_footer_sync_info():3953] logging synced files | |